2024-04-13T02:34:04.199 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-13T02:34:04.200 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi --owner scheduled_vshankar@teuthology --verbose --archive /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} -- /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/orig.config.yaml 2024-04-13T02:34:04.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T02:34:04.330 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667 branch: wip-vshankar-testing-20240411.061452 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} email: vshankar@redhat.com first_in_suite: false job_id: '7653667' kernel: client: sha1: distro flavor: default kdb: true sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240411.061452 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 324baf8ddb91dea46cac50cb535c306115791355 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 324baf8ddb91dea46cac50cb535c306115791355 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240411.061452 sha1: 324baf8ddb91dea46cac50cb535c306115791355 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7105 sha1: 324baf8ddb91dea46cac50cb535c306115791355 sleep_before_teardown: 0 subset: 463/1024 suite: fs suite_branch: wip-vshankar-testing-20240411.061452 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 324baf8ddb91dea46cac50cb535c306115791355 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDE4YhKRzoHEMOzeuc1OkPtp76JiTyhKvGWF3lV3snxdzoIPxA6aQ2CjyRntFh+gxi2kYhBfZevPWQZg1cBQLzo= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAevLdcjM1VWjO0GvH+dV2t5V5YP8Z2aQA0cMcZTIXYfY/68XOtEFSsZeRtZf9ulmVQaQT7ZzPy21OyTZ+yMIk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_backtrace teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-12_03:11:38 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-13T02:34:04.330 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa; will attempt to use it 2024-04-13T02:34:04.331 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks 2024-04-13T02:34:04.331 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-13T02:34:04.338 INFO:teuthology.task.internal:Checking packages... 2024-04-13T02:34:04.366 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '324baf8ddb91dea46cac50cb535c306115791355' 2024-04-13T02:34:04.366 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-13T02:34:04.367 INFO:teuthology.packaging:ref: None 2024-04-13T02:34:04.367 INFO:teuthology.packaging:tag: None 2024-04-13T02:34:04.367 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240411.061452 2024-04-13T02:34:04.367 INFO:teuthology.packaging:sha1: 324baf8ddb91dea46cac50cb535c306115791355 2024-04-13T02:34:04.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240411.061452 2024-04-13T02:34:04.592 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2879.g324baf8d 2024-04-13T02:34:04.593 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-13T02:34:04.600 INFO:teuthology.task.internal:no buildpackages task found 2024-04-13T02:34:04.600 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-13T02:34:04.619 INFO:teuthology.task.internal:Saving configuration 2024-04-13T02:34:04.639 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-13T02:34:04.644 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-13T02:34:04.671 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 02:29:02.428895', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDE4YhKRzoHEMOzeuc1OkPtp76JiTyhKvGWF3lV3snxdzoIPxA6aQ2CjyRntFh+gxi2kYhBfZevPWQZg1cBQLzo='} 2024-04-13T02:34:04.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 02:29:02.427514', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAevLdcjM1VWjO0GvH+dV2t5V5YP8Z2aQA0cMcZTIXYfY/68XOtEFSsZeRtZf9ulmVQaQT7ZzPy21OyTZ+yMIk='} 2024-04-13T02:34:04.693 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-13T02:34:04.699 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-13T02:34:04.699 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-13T02:34:04.699 INFO:teuthology.run_tasks:Running task console_log... 2024-04-13T02:34:04.772 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6bf394160>, signals=[15]) 2024-04-13T02:34:04.772 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-13T02:34:04.780 INFO:teuthology.task.internal:Opening connections... 2024-04-13T02:34:04.780 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:34:04.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:34:04.873 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:34:04.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:34:04.961 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-13T02:34:04.968 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-04-13T02:34:04.985 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-04-13T02:34:04.986 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-04-13T02:34:05.042 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-04-13T02:34:05.042 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-04-13T02:34:05.042 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-04-13T02:34:05.042 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-04-13T02:34:05.042 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-04-13T02:34:05.042 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-13T02:34:05.043 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T02:34:05.044 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-04-13T02:34:05.069 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-04-13T02:34:05.086 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-04-13T02:34:05.086 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-13T02:34:05.142 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-04-13T02:34:05.142 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-04-13T02:34:05.142 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-04-13T02:34:05.142 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-04-13T02:34:05.142 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-04-13T02:34:05.142 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-13T02:34:05.143 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-13T02:34:05.143 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-13T02:34:05.168 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-13T02:34:05.177 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-13T02:34:05.183 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-13T02:34:05.183 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-04-13T02:34:05.185 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-04-13T02:34:05.201 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-13T02:34:05.207 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-13T02:34:05.207 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-04-13T02:34:05.241 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-04-13T02:34:05.389 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-13T02:34:05.448 INFO:teuthology.run_tasks:Running task kernel... 2024-04-13T02:34:05.465 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'} 2024-04-13T02:34:05.465 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-13T02:34:05.465 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-13T02:34:05.465 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-13T02:34:05.466 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-13T02:34:05.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:34:05.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:34:05.483 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-04-13T02:34:05.483 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-04-13T02:34:05.539 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-361.el9.x86_64 2024-04-13T02:34:05.539 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.14.0-361.el9.x86_64 2024-04-13T02:34:05.540 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2024-04-13T02:34:05.541 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-361.el9.x86_64 2024-04-13T02:34:05.541 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.14.0-361.el9.x86_64 2024-04-13T02:34:05.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2024-04-13T02:34:07.654 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-04-13T02:34:07.748 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-04-13T02:34:09.296 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.5 MB 00:00 2024-04-13T02:34:09.366 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - BaseOS 9.1 MB/s | 2.5 MB 00:00 2024-04-13T02:34:10.244 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-13T02:34:10.731 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.0 MB 00:00 2024-04-13T02:34:11.920 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 34 MB/s | 19 MB 00:00 2024-04-13T02:34:12.649 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-13T02:34:15.996 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-13T02:34:16.650 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-04-13T02:34:17.414 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-04-13T02:34:18.242 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-13T02:34:18.499 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-13T02:34:19.338 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-13T02:34:23.582 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-04-13T02:34:24.460 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-13T02:34:25.832 INFO:teuthology.orchestra.run.smithi130.stderr:Modular dependency problems: 2024-04-13T02:34:25.832 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-04-13T02:34:25.832 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 1: conflicting requests 2024-04-13T02:34:25.832 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 2: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 3: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 4: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 5: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 6: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 7: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 8: conflicting requests 2024-04-13T02:34:25.833 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 9: conflicting requests 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 10: conflicting requests 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 11: conflicting requests 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 12: conflicting requests 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 13: conflicting requests 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 14: conflicting requests 2024-04-13T02:34:25.834 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 15: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 16: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 17: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 18: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 19: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 20: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 21: conflicting requests 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.835 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 22: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 23: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 24: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 25: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 26: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 27: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 28: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 29: conflicting requests 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.836 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 30: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 31: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 32: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 33: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 34: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 35: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 36: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 37: conflicting requests 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.837 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 38: cannot install the best candidate for the job 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 39: conflicting requests 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 40: cannot install the best candidate for the job 2024-04-13T02:34:25.838 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 41: cannot install the best candidate for the job 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 42: cannot install the best candidate for the job 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 43: cannot install the best candidate for the job 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.839 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 44: cannot install the best candidate for the job 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 45: cannot install the best candidate for the job 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-13T02:34:25.840 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.189 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-13T02:34:26.189 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-13T02:34:26.303 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-13T02:34:26.310 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:Install 4 Packages 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 77 M 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 123 M 2024-04-13T02:34:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-04-13T02:34:26.650 INFO:teuthology.orchestra.run.smithi130.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 939 kB/s | 214 kB 00:00 2024-04-13T02:34:26.745 INFO:teuthology.orchestra.run.smithi114.stderr:Modular dependency problems: 2024-04-13T02:34:26.745 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:34:26.745 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 1: conflicting requests 2024-04-13T02:34:26.745 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.745 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 2: conflicting requests 2024-04-13T02:34:26.745 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 3: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 4: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 5: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 6: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 7: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 8: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 9: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 10: conflicting requests 2024-04-13T02:34:26.746 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 11: conflicting requests 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 12: conflicting requests 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 13: conflicting requests 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 14: conflicting requests 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 15: conflicting requests 2024-04-13T02:34:26.747 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 16: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 17: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 18: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 19: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 20: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 21: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 22: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 23: conflicting requests 2024-04-13T02:34:26.748 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 24: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 25: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 26: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 27: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 28: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 29: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 30: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 31: conflicting requests 2024-04-13T02:34:26.749 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 32: conflicting requests 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 33: conflicting requests 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 34: conflicting requests 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 35: conflicting requests 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 36: conflicting requests 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 37: conflicting requests 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.750 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 38: cannot install the best candidate for the job 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 39: conflicting requests 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 40: cannot install the best candidate for the job 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.751 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 41: cannot install the best candidate for the job 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 42: cannot install the best candidate for the job 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 43: cannot install the best candidate for the job 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.752 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 44: cannot install the best candidate for the job 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 45: cannot install the best candidate for the job 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.753 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-13T02:34:26.754 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-13T02:34:27.134 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-13T02:34:27.134 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-13T02:34:27.184 INFO:teuthology.orchestra.run.smithi130.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 20 MB/s | 15 MB 00:00 2024-04-13T02:34:27.248 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-13T02:34:27.259 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:Install 4 Packages 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 77 M 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 123 M 2024-04-13T02:34:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-13T02:34:27.859 INFO:teuthology.orchestra.run.smithi130.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 23 MB/s | 34 MB 00:01 2024-04-13T02:34:28.170 INFO:teuthology.orchestra.run.smithi114.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 358 kB/s | 214 kB 00:00 2024-04-13T02:34:28.217 INFO:teuthology.orchestra.run.smithi130.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 18 MB/s | 28 MB 00:01 2024-04-13T02:34:28.218 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-04-13T02:34:28.218 INFO:teuthology.orchestra.run.smithi130.stdout:Total 40 MB/s | 77 MB 00:01 2024-04-13T02:34:28.884 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-04-13T02:34:29.249 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-04-13T02:34:29.249 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-04-13T02:34:30.251 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-04-13T02:34:30.251 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-04-13T02:34:32.754 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-04-13T02:34:33.345 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-13T02:34:33.426 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-13T02:34:35.686 INFO:teuthology.orchestra.run.smithi114.stdout:(2/4): kernel-modules-core-5.14.0-435.el9.x86_6 3.7 MB/s | 28 MB 00:07 2024-04-13T02:34:36.212 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-13T02:34:36.372 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-13T02:34:41.074 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-13T02:34:41.183 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:34:42.105 INFO:teuthology.orchestra.run.smithi114.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 2.3 MB/s | 34 MB 00:14 2024-04-13T02:34:43.195 INFO:teuthology.orchestra.run.smithi114.stdout:(4/4): kernel-core-5.14.0-435.el9.x86_64.rpm 990 kB/s | 15 MB 00:15 2024-04-13T02:34:43.195 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-13T02:34:43.195 INFO:teuthology.orchestra.run.smithi114.stdout:Total 4.8 MB/s | 77 MB 00:15 2024-04-13T02:34:43.871 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-13T02:34:44.206 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-13T02:34:44.206 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-13T02:34:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-13T02:34:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-13T02:34:45.913 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:34:47.734 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-13T02:34:48.440 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-13T02:34:48.536 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-13T02:34:51.278 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-13T02:34:51.421 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-13T02:34:56.164 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-13T02:34:56.213 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:00.971 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:15.024 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:15.024 INFO:teuthology.orchestra.run.smithi130.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-13T02:35:15.024 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:35:15.070 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:15.398 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:15.398 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-13T02:35:15.398 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-13T02:35:15.398 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:35:15.810 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-04-13T02:35:16.136 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T02:35:16.248 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-13T02:35:16.248 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-13T02:35:16.249 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-13T02:35:16.249 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-13T02:35:16.249 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-13T02:35:16.249 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-13T02:35:16.249 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2024-04-13T02:35:16.249 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T02:35:16.330 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-13T02:35:16.330 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-13T02:35:16.331 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 68.el9 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8264254 2024-04-13T02:35:16.365 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-13T02:35:16.366 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2024-04-13T02:35:16.367 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:35:16.367 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2024-04-13T02:35:16.367 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-13T02:35:16.368 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 5.14.0-435.el9.x86_64 2024-04-13T02:35:16.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-13T02:35:16.976 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-04-13T02:35:18.325 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-13T02:35:18.354 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-04-13T02:35:18.373 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-13T02:35:18.396 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.qkDddN19t1 2024-04-13T02:35:18.396 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qkDddN19t1 2024-04-13T02:35:18.464 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.qkDddN19t1 2024-04-13T02:35:18.605 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.qkDddN19t1 is 6KB 2024-04-13T02:35:18.654 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.qkDddN19t1 2024-04-13T02:35:18.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2024-04-13T02:35:18.732 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-13T02:35:18.732 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-13T02:35:18.732 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-13T02:35:18.733 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-13T02:35:18.734 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-13T02:35:18.889 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-04-13T02:35:30.135 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:30.136 INFO:teuthology.orchestra.run.smithi114.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-13T02:35:30.136 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:35:30.181 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-13T02:35:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-13T02:35:30.520 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-13T02:35:30.943 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-13T02:35:30.943 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:35:30.943 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-13T02:35:30.943 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-13T02:35:30.943 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-13T02:35:30.943 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-13T02:35:30.944 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-13T02:35:30.944 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:35:30.944 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-13T02:35:31.311 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T02:35:31.412 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-13T02:35:31.413 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-13T02:35:31.413 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-13T02:35:31.413 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-13T02:35:31.413 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-13T02:35:31.413 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-13T02:35:31.413 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2024-04-13T02:35:31.413 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-04-13T02:35:31.493 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-13T02:35:31.494 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-13T02:35:31.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.06 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 68.el9 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Group : Unspecified 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 8264254 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-13T02:35:31.539 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : builder@centos.org 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:35:31.540 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2024-04-13T02:35:31.541 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-13T02:35:31.541 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 5.14.0-435.el9.x86_64 2024-04-13T02:35:31.541 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-13T02:35:32.172 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-04-13T02:35:33.502 INFO:teuthology.orchestra.run.smithi114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-13T02:35:33.537 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-04-13T02:35:33.540 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-04-13T02:35:33.555 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.XjHyUSvDci 2024-04-13T02:35:33.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XjHyUSvDci 2024-04-13T02:35:33.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.XjHyUSvDci 2024-04-13T02:35:33.754 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.XjHyUSvDci is 6KB 2024-04-13T02:35:33.801 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.XjHyUSvDci 2024-04-13T02:35:33.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2024-04-13T02:35:33.882 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-13T02:35:33.882 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-13T02:35:33.882 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-13T02:35:33.882 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-13T02:35:33.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-13T02:35:34.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-04-13T02:35:48.907 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-13T02:35:48.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-13T02:35:48.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:36:04.058 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-13T02:36:04.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-13T02:36:04.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:36:23.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-13T02:36:32.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-13T02:36:32.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:36:38.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-13T02:36:47.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-13T02:36:47.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:36:50.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-13T02:37:02.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-13T02:37:02.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:37:03.270 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-13T02:37:03.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-13T02:37:03.693 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-435.el9.x86_64"... 2024-04-13T02:37:03.694 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-04-13T02:37:03.707 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-435.el9.x86_64 2024-04-13T02:37:03.708 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-13T02:37:03.708 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-13T02:37:03.708 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-13T02:37:04.708 DEBUG:teuthology.parallel:result is None 2024-04-13T02:37:05.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-13T02:37:17.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-13T02:37:17.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:37:18.475 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-04-13T02:37:18.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-13T02:37:18.960 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-435.el9.x86_64"... 2024-04-13T02:37:18.960 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-04-13T02:37:18.975 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-435.el9.x86_64 2024-04-13T02:37:18.975 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-13T02:37:18.975 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-13T02:37:18.975 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-13T02:37:19.976 DEBUG:teuthology.parallel:result is None 2024-04-13T02:37:19.976 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-13T02:37:19.985 INFO:teuthology.task.internal:Creating test directory... 2024-04-13T02:37:19.985 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-13T02:37:19.988 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-13T02:37:20.007 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-13T02:37:20.018 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-13T02:37:20.033 INFO:teuthology.task.internal:Creating archive directory... 2024-04-13T02:37:20.033 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-13T02:37:20.043 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-13T02:37:20.080 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-13T02:37:20.091 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-13T02:37:20.091 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-13T02:37:20.099 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-13T02:37:20.170 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T02:37:20.194 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T02:37:20.222 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T02:37:20.240 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-13T02:37:20.242 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-13T02:37:20.254 INFO:teuthology.task.internal:Configuring sudo... 2024-04-13T02:37:20.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-13T02:37:20.256 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-13T02:37:20.287 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-13T02:37:20.312 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-13T02:37:20.312 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-13T02:37:20.324 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-13T02:37:20.343 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T02:37:20.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T02:37:20.469 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T02:37:20.551 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T02:37:20.591 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:37:20.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-13T02:37:20.661 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T02:37:20.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-13T02:37:20.765 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T02:37:20.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-13T02:37:20.894 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:37:20.894 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-13T02:37:20.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-04-13T02:37:20.966 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-04-13T02:37:21.010 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T02:37:21.063 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T02:37:21.564 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-13T02:37:21.573 INFO:teuthology.task.internal:Starting timer... 2024-04-13T02:37:21.574 INFO:teuthology.run_tasks:Running task pcp... 2024-04-13T02:37:21.591 INFO:teuthology.run_tasks:Running task selinux... 2024-04-13T02:37:21.604 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-13T02:37:21.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-04-13T02:37:21.666 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-04-13T02:37:21.668 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-04-13T02:37:21.744 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-04-13T02:37:21.746 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-13T02:37:21.746 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-04-13T02:37:21.786 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-04-13T02:37:21.786 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-04-13T02:37:21.811 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-04-13T02:37:21.811 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2024-04-13T02:37:21.811 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-13T02:37:21.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:37:21.857 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-13T02:37:21.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:37:21.886 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-13T02:37:21.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-04-13T02:37:21.938 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-04-13T02:37:21.979 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-13T02:37:21.997 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-13T02:37:22.015 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-13T02:37:22.016 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-13T02:41:37.924 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-04-13T02:41:37.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-13T02:41:37.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:41:38.017 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-04-13T02:41:38.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-13T02:41:38.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-13T02:41:38.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T02:41:38.191 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-13T02:41:38.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-13T02:41:38.282 INFO:teuthology.run_tasks:Running task clock... 2024-04-13T02:41:38.294 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-13T02:41:38.294 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-13T02:41:38.294 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T02:41:38.297 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-13T02:41:38.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T02:41:38.325 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-13T02:41:38.341 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-13T02:41:38.352 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-13T02:41:38.370 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-13T02:41:38.370 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-04-13T02:41:38.384 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-04-13T02:41:38.400 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-04-13T02:41:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-13T02:41:38.413 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-04-13T02:41:38.416 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-13T02:41:38.430 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-13T02:41:38.446 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-13T02:41:38.469 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-04-13T02:41:38.473 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T02:41:38.473 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-04-13T02:41:38.473 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.473 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.473 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.473 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.502 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-04-13T02:41:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T02:41:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-04-13T02:41:38.506 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.507 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:41:38.507 INFO:teuthology.run_tasks:Running task install... 2024-04-13T02:41:38.516 DEBUG:teuthology.task.install:project ceph 2024-04-13T02:41:38.516 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}} 2024-04-13T02:41:38.516 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'} 2024-04-13T02:41:38.516 INFO:teuthology.task.install:Using flavor: default 2024-04-13T02:41:38.522 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-13T02:41:38.522 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-13T02:41:38.522 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'tag': None, 'wait_for_package': False} 2024-04-13T02:41:38.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-13T02:41:38.525 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'tag': None, 'wait_for_package': False} 2024-04-13T02:41:38.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-13T02:41:38.668 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/ 2024-04-13T02:41:38.669 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2879.g324baf8d 2024-04-13T02:41:38.674 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/ 2024-04-13T02:41:38.674 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2879.g324baf8d 2024-04-13T02:41:38.779 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-13T02:41:38.779 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:41:38.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-13T02:41:38.808 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-13T02:41:38.809 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/324baf8ddb91dea46cac50cb535c306115791355/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-13T02:41:38.848 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-13T02:41:38.848 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:41:38.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-13T02:41:38.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-13T02:41:38.877 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-13T02:41:38.878 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/324baf8ddb91dea46cac50cb535c306115791355/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-13T02:41:38.946 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-13T02:41:38.956 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-13T02:41:39.022 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-04-13T02:41:39.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-04-13T02:41:39.025 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-13T02:41:39.091 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-04-13T02:41:39.093 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-04-13T02:41:39.268 INFO:teuthology.orchestra.run.smithi114.stdout:74 files removed 2024-04-13T02:41:39.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-13T02:41:39.338 INFO:teuthology.orchestra.run.smithi130.stdout:74 files removed 2024-04-13T02:41:39.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-13T02:41:40.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 201 kB/s | 83 kB 00:00 2024-04-13T02:41:40.137 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 177 kB/s | 83 kB 00:00 2024-04-13T02:41:40.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-04-13T02:41:40.563 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-13T02:41:40.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-13T02:41:40.913 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-04-13T02:41:41.191 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - AppStream 21 MB/s | 8.1 MB 00:00 2024-04-13T02:41:41.341 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - AppStream 21 MB/s | 8.1 MB 00:00 2024-04-13T02:41:42.841 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - BaseOS 7.6 MB/s | 2.5 MB 00:00 2024-04-13T02:41:42.949 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - BaseOS 8.6 MB/s | 2.5 MB 00:00 2024-04-13T02:41:47.865 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.0 MB 00:04 2024-04-13T02:41:50.068 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-13T02:41:52.247 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 931 kB/s | 8.0 MB 00:08 2024-04-13T02:41:54.290 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-13T02:41:58.733 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.2 MB 00:00 2024-04-13T02:42:00.575 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-13T02:42:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 800 kB/s | 6.2 MB 00:07 2024-04-13T02:42:01.810 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-13T02:42:03.342 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-04-13T02:42:04.343 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-13T02:42:06.910 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-13T02:42:09.435 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-13T02:42:09.464 INFO:teuthology.orchestra.run.smithi130.stderr:Modular dependency problems: 2024-04-13T02:42:09.464 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-04-13T02:42:09.464 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 1: conflicting requests 2024-04-13T02:42:09.464 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.464 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 2: conflicting requests 2024-04-13T02:42:09.464 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 3: conflicting requests 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 4: conflicting requests 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 5: conflicting requests 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 6: conflicting requests 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 7: conflicting requests 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 8: conflicting requests 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.465 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 9: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 10: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 11: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 12: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 13: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 14: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 15: conflicting requests 2024-04-13T02:42:09.466 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 16: conflicting requests 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 17: conflicting requests 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 18: conflicting requests 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 19: conflicting requests 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 20: conflicting requests 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 21: conflicting requests 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.467 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 22: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 23: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 24: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 25: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 26: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 27: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 28: conflicting requests 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.468 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 29: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 30: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 31: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 32: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 33: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 34: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 35: conflicting requests 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.469 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 36: conflicting requests 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 37: conflicting requests 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 38: cannot install the best candidate for the job 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 39: conflicting requests 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.470 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 40: cannot install the best candidate for the job 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 41: cannot install the best candidate for the job 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.471 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 42: cannot install the best candidate for the job 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 43: cannot install the best candidate for the job 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 44: cannot install the best candidate for the job 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.472 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.473 INFO:teuthology.orchestra.run.smithi130.stderr: Problem 45: cannot install the best candidate for the job 2024-04-13T02:42:09.473 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.473 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.473 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.473 INFO:teuthology.orchestra.run.smithi130.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-13T02:42:09.939 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-13T02:42:09.940 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-13T02:42:09.953 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-13T02:42:09.954 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-13T02:42:09.955 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-13T02:42:09.956 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-13T02:42:09.958 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-13T02:42:09.960 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-13T02:42:09.961 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-13T02:42:10.055 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-04-13T02:42:10.074 INFO:teuthology.orchestra.run.smithi130.stdout:========================================================================================= 2024-04-13T02:42:10.074 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-04-13T02:42:10.074 INFO:teuthology.orchestra.run.smithi130.stdout:========================================================================================= 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 6.6 k 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.4 M 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 889 k 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 145 k 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 1.5 M 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 142 k 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 3.5 M 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 7.4 M 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 49 k 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 10 M 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 49 M 2024-04-13T02:42:10.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 264 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 762 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 224 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 27 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 18 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 32 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 746 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 127 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-13T02:42:10.076 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 161 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 320 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 297 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 99 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 85 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 171 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-13T02:42:10.077 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.4 M 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-13T02:42:10.078 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 21 M 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 34 k 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 2.4 M 2024-04-13T02:42:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 249 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 4.7 M 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 17 M 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 16 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 25 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-13T02:42:10.080 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 164 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 500 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.2 M 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-13T02:42:10.081 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-13T02:42:10.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 45 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 135 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-13T02:42:10.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-13T02:42:10.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-13T02:42:10.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-13T02:42:10.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-13T02:42:10.087 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout:========================================================================================= 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout:Install 150 Packages 2024-04-13T02:42:10.088 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 24 Packages 2024-04-13T02:42:10.089 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:42:10.089 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 229 M 2024-04-13T02:42:10.089 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-04-13T02:42:10.995 INFO:teuthology.orchestra.run.smithi130.stdout:(1/174): ceph-19.0.0-2879.g324baf8d.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-04-13T02:42:11.370 INFO:teuthology.orchestra.run.smithi130.stdout:(2/174): ceph-base-19.0.0-2879.g324baf8d.el9.x8 8.8 MB/s | 5.4 MB 00:00 2024-04-13T02:42:11.437 INFO:teuthology.orchestra.run.smithi130.stdout:(3/174): ceph-immutable-object-cache-19.0.0-287 2.1 MB/s | 145 kB 00:00 2024-04-13T02:42:11.671 INFO:teuthology.orchestra.run.smithi130.stdout:(4/174): ceph-mds-19.0.0-2879.g324baf8d.el9.x86 10 MB/s | 2.4 MB 00:00 2024-04-13T02:42:11.729 INFO:teuthology.orchestra.run.smithi130.stdout:(5/174): ceph-fuse-19.0.0-2879.g324baf8d.el9.x8 1.2 MB/s | 889 kB 00:00 2024-04-13T02:42:11.812 INFO:teuthology.orchestra.run.smithi130.stdout:(6/174): ceph-mgr-19.0.0-2879.g324baf8d.el9.x86 11 MB/s | 1.5 MB 00:00 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr:Modular dependency problems: 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 1: conflicting requests 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 2: conflicting requests 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.000 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 3: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 4: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 5: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 6: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 7: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 8: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 9: conflicting requests 2024-04-13T02:42:12.001 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 10: conflicting requests 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 11: conflicting requests 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 12: conflicting requests 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 13: conflicting requests 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 14: conflicting requests 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 15: conflicting requests 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.002 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 16: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 17: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 18: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 19: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 20: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 21: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 22: conflicting requests 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.003 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 23: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 24: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 25: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 26: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 27: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 28: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 29: conflicting requests 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.004 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 30: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 31: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 32: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 33: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 34: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 35: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 36: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 37: conflicting requests 2024-04-13T02:42:12.005 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 38: cannot install the best candidate for the job 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 39: conflicting requests 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.006 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 40: cannot install the best candidate for the job 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 41: cannot install the best candidate for the job 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 42: cannot install the best candidate for the job 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.007 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 43: cannot install the best candidate for the job 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 44: cannot install the best candidate for the job 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: Problem 45: cannot install the best candidate for the job 2024-04-13T02:42:12.008 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.009 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.009 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.009 INFO:teuthology.orchestra.run.smithi114.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-13T02:42:12.524 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-13T02:42:12.525 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-13T02:42:12.539 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-13T02:42:12.539 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-13T02:42:12.541 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-13T02:42:12.542 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-13T02:42:12.544 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-13T02:42:12.549 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-13T02:42:12.550 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-13T02:42:12.642 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-13T02:42:12.665 INFO:teuthology.orchestra.run.smithi114.stdout:========================================================================================= 2024-04-13T02:42:12.665 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-04-13T02:42:12.665 INFO:teuthology.orchestra.run.smithi114.stdout:========================================================================================= 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 6.6 k 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.4 M 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 889 k 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 145 k 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 1.5 M 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 142 k 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 3.5 M 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 7.4 M 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 49 k 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 10 M 2024-04-13T02:42:12.666 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 49 M 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 264 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 762 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 224 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 27 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 18 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 32 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 746 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 127 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-13T02:42:12.667 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 161 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 320 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 297 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 99 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 85 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 171 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-04-13T02:42:12.668 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi114.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.4 M 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-13T02:42:12.670 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 21 M 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 34 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 2.4 M 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 249 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 4.7 M 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 17 M 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 16 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 25 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-13T02:42:12.671 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 164 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-13T02:42:12.672 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 500 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.2 M 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-13T02:42:12.673 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-13T02:42:12.674 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 45 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 135 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-13T02:42:12.675 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-13T02:42:12.676 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-13T02:42:12.677 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-13T02:42:12.678 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-13T02:42:12.679 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout:========================================================================================= 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout:Install 150 Packages 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 24 Packages 2024-04-13T02:42:12.680 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:42:12.681 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 229 M 2024-04-13T02:42:12.681 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-13T02:42:12.704 INFO:teuthology.orchestra.run.smithi130.stdout:(7/174): ceph-common-19.0.0-2879.g324baf8d.el9. 11 MB/s | 21 MB 00:01 2024-04-13T02:42:13.055 INFO:teuthology.orchestra.run.smithi130.stdout:(8/174): ceph-osd-19.0.0-2879.g324baf8d.el9.x86 14 MB/s | 17 MB 00:01 2024-04-13T02:42:13.097 INFO:teuthology.orchestra.run.smithi130.stdout:(9/174): ceph-selinux-19.0.0-2879.g324baf8d.el9 611 kB/s | 25 kB 00:00 2024-04-13T02:42:13.455 INFO:teuthology.orchestra.run.smithi130.stdout:(10/174): ceph-radosgw-19.0.0-2879.g324baf8d.el 13 MB/s | 10 MB 00:00 2024-04-13T02:42:13.530 INFO:teuthology.orchestra.run.smithi130.stdout:(11/174): ceph-mon-19.0.0-2879.g324baf8d.el9.x8 2.6 MB/s | 4.7 MB 00:01 2024-04-13T02:42:13.556 INFO:teuthology.orchestra.run.smithi130.stdout:(12/174): cephfs-mirror-19.0.0-2879.g324baf8d.e 2.2 MB/s | 224 kB 00:00 2024-04-13T02:42:13.561 INFO:teuthology.orchestra.run.smithi114.stdout:(1/174): ceph-19.0.0-2879.g324baf8d.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-04-13T02:42:13.589 INFO:teuthology.orchestra.run.smithi130.stdout:(13/174): cephfs-shell-19.0.0-2879.g324baf8d.el 462 kB/s | 27 kB 00:00 2024-04-13T02:42:13.615 INFO:teuthology.orchestra.run.smithi130.stdout:(14/174): libcephfs-devel-19.0.0-2879.g324baf8d 542 kB/s | 32 kB 00:00 2024-04-13T02:42:13.707 INFO:teuthology.orchestra.run.smithi130.stdout:(15/174): libcephsqlite-19.0.0-2879.g324baf8d.e 1.7 MB/s | 164 kB 00:00 2024-04-13T02:42:13.790 INFO:teuthology.orchestra.run.smithi130.stdout:(16/174): librados-devel-19.0.0-2879.g324baf8d. 1.5 MB/s | 127 kB 00:00 2024-04-13T02:42:13.815 INFO:teuthology.orchestra.run.smithi130.stdout:(17/174): libcephfs2-19.0.0-2879.g324baf8d.el9. 3.2 MB/s | 746 kB 00:00 2024-04-13T02:42:13.891 INFO:teuthology.orchestra.run.smithi130.stdout:(18/174): libradosstriper1-19.0.0-2879.g324baf8 4.9 MB/s | 500 kB 00:00 2024-04-13T02:42:13.966 INFO:teuthology.orchestra.run.smithi130.stdout:(19/174): python3-ceph-argparse-19.0.0-2879.g32 603 kB/s | 45 kB 00:00 2024-04-13T02:42:14.058 INFO:teuthology.orchestra.run.smithi130.stdout:(20/174): python3-ceph-common-19.0.0-2879.g324b 1.4 MB/s | 135 kB 00:00 2024-04-13T02:42:14.158 INFO:teuthology.orchestra.run.smithi130.stdout:(21/174): python3-cephfs-19.0.0-2879.g324baf8d. 1.6 MB/s | 161 kB 00:00 2024-04-13T02:42:14.267 INFO:teuthology.orchestra.run.smithi130.stdout:(22/174): python3-rados-19.0.0-2879.g324baf8d.e 2.9 MB/s | 320 kB 00:00 2024-04-13T02:42:14.286 INFO:teuthology.orchestra.run.smithi114.stdout:(2/174): ceph-fuse-19.0.0-2879.g324baf8d.el9.x8 1.2 MB/s | 889 kB 00:00 2024-04-13T02:42:14.367 INFO:teuthology.orchestra.run.smithi130.stdout:(23/174): python3-rbd-19.0.0-2879.g324baf8d.el9 2.9 MB/s | 297 kB 00:00 2024-04-13T02:42:14.444 INFO:teuthology.orchestra.run.smithi114.stdout:(3/174): ceph-immutable-object-cache-19.0.0-287 914 kB/s | 145 kB 00:00 2024-04-13T02:42:14.450 INFO:teuthology.orchestra.run.smithi130.stdout:(24/174): python3-rgw-19.0.0-2879.g324baf8d.el9 1.2 MB/s | 99 kB 00:00 2024-04-13T02:42:14.534 INFO:teuthology.orchestra.run.smithi130.stdout:(25/174): rbd-fuse-19.0.0-2879.g324baf8d.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-13T02:42:14.851 INFO:teuthology.orchestra.run.smithi130.stdout:(26/174): librgw2-19.0.0-2879.g324baf8d.el9.x86 5.0 MB/s | 5.2 MB 00:01 2024-04-13T02:42:14.918 INFO:teuthology.orchestra.run.smithi130.stdout:(27/174): rbd-mirror-19.0.0-2879.g324baf8d.el9. 8.0 MB/s | 3.1 MB 00:00 2024-04-13T02:42:14.944 INFO:teuthology.orchestra.run.smithi130.stdout:(28/174): rbd-nbd-19.0.0-2879.g324baf8d.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-13T02:42:14.977 INFO:teuthology.orchestra.run.smithi130.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2879.g 586 kB/s | 34 kB 00:00 2024-04-13T02:42:15.027 INFO:teuthology.orchestra.run.smithi130.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2879.g324baf8 1.7 MB/s | 142 kB 00:00 2024-04-13T02:42:15.295 INFO:teuthology.orchestra.run.smithi114.stdout:(4/174): ceph-mds-19.0.0-2879.g324baf8d.el9.x86 2.8 MB/s | 2.4 MB 00:00 2024-04-13T02:42:15.428 INFO:teuthology.orchestra.run.smithi130.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2879.g324ba 7.9 MB/s | 3.5 MB 00:00 2024-04-13T02:42:15.519 INFO:teuthology.orchestra.run.smithi130.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2879.g32 2.7 MB/s | 249 kB 00:00 2024-04-13T02:42:15.603 INFO:teuthology.orchestra.run.smithi130.stdout:(33/174): ceph-mgr-rook-19.0.0-2879.g324baf8d.e 591 kB/s | 49 kB 00:00 2024-04-13T02:42:15.645 INFO:teuthology.orchestra.run.smithi114.stdout:(5/174): ceph-mgr-19.0.0-2879.g324baf8d.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-04-13T02:42:15.661 INFO:teuthology.orchestra.run.smithi130.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2879.g3 283 kB/s | 16 kB 00:00 2024-04-13T02:42:15.745 INFO:teuthology.orchestra.run.smithi130.stdout:(35/174): ceph-volume-19.0.0-2879.g324baf8d.el9 3.1 MB/s | 264 kB 00:00 2024-04-13T02:42:15.912 INFO:teuthology.orchestra.run.smithi130.stdout:(36/174): cephadm-19.0.0-2879.g324baf8d.el9.noa 4.5 MB/s | 762 kB 00:00 2024-04-13T02:42:15.996 INFO:teuthology.orchestra.run.smithi130.stdout:(37/174): cephfs-top-19.0.0-2879.g324baf8d.el9. 219 kB/s | 18 kB 00:00 2024-04-13T02:42:16.088 INFO:teuthology.orchestra.run.smithi130.stdout:(38/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 192 kB/s | 18 kB 00:00 2024-04-13T02:42:16.104 INFO:teuthology.orchestra.run.smithi114.stdout:(6/174): ceph-base-19.0.0-2879.g324baf8d.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-04-13T02:42:16.222 INFO:teuthology.orchestra.run.smithi130.stdout:(39/174): fuse-2.9.9-15.el9.x86_64.rpm 602 kB/s | 80 kB 00:00 2024-04-13T02:42:16.339 INFO:teuthology.orchestra.run.smithi130.stdout:(40/174): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2024-04-13T02:42:16.364 INFO:teuthology.orchestra.run.smithi130.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-04-13T02:42:16.396 INFO:teuthology.orchestra.run.smithi114.stdout:(7/174): ceph-mon-19.0.0-2879.g324baf8d.el9.x86 6.3 MB/s | 4.7 MB 00:00 2024-04-13T02:42:16.414 INFO:teuthology.orchestra.run.smithi130.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-13T02:42:16.464 INFO:teuthology.orchestra.run.smithi130.stdout:(43/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 218 kB 00:00 2024-04-13T02:42:16.899 INFO:teuthology.orchestra.run.smithi130.stdout:(44/174): ceph-test-19.0.0-2879.g324baf8d.el9.x 13 MB/s | 49 MB 00:03 2024-04-13T02:42:16.923 INFO:teuthology.orchestra.run.smithi130.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 552 kB/s | 253 kB 00:00 2024-04-13T02:42:16.966 INFO:teuthology.orchestra.run.smithi130.stdout:(46/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-04-13T02:42:16.979 INFO:teuthology.orchestra.run.smithi114.stdout:(8/174): ceph-radosgw-19.0.0-2879.g324baf8d.el9 17 MB/s | 10 MB 00:00 2024-04-13T02:42:16.991 INFO:teuthology.orchestra.run.smithi130.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-13T02:42:17.013 INFO:teuthology.orchestra.run.smithi114.stdout:(9/174): ceph-selinux-19.0.0-2879.g324baf8d.el9 766 kB/s | 25 kB 00:00 2024-04-13T02:42:17.016 INFO:teuthology.orchestra.run.smithi130.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-13T02:42:17.041 INFO:teuthology.orchestra.run.smithi130.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-13T02:42:17.075 INFO:teuthology.orchestra.run.smithi130.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-13T02:42:17.167 INFO:teuthology.orchestra.run.smithi130.stdout:(51/174): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-04-13T02:42:17.233 INFO:teuthology.orchestra.run.smithi130.stdout:(52/174): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-04-13T02:42:17.276 INFO:teuthology.orchestra.run.smithi130.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 514 kB/s | 21 kB 00:00 2024-04-13T02:42:17.301 INFO:teuthology.orchestra.run.smithi130.stdout:(54/174): boost-program-options-1.75.0-8.el9.x8 800 kB/s | 107 kB 00:00 2024-04-13T02:42:17.334 INFO:teuthology.orchestra.run.smithi130.stdout:(55/174): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-13T02:42:17.360 INFO:teuthology.orchestra.run.smithi130.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-04-13T02:42:17.393 INFO:teuthology.orchestra.run.smithi130.stdout:(57/174): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-04-13T02:42:17.418 INFO:teuthology.orchestra.run.smithi130.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-04-13T02:42:17.444 INFO:teuthology.orchestra.run.smithi130.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-13T02:42:17.469 INFO:teuthology.orchestra.run.smithi130.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-04-13T02:42:17.503 INFO:teuthology.orchestra.run.smithi130.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-13T02:42:17.561 INFO:teuthology.orchestra.run.smithi130.stdout:(62/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-13T02:42:17.587 INFO:teuthology.orchestra.run.smithi130.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-04-13T02:42:17.612 INFO:teuthology.orchestra.run.smithi130.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-13T02:42:17.637 INFO:teuthology.orchestra.run.smithi130.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-13T02:42:17.671 INFO:teuthology.orchestra.run.smithi130.stdout:(66/174): libtool-2.4.6-45.el9.x86_64.rpm 2.8 MB/s | 582 kB 00:00 2024-04-13T02:42:17.696 INFO:teuthology.orchestra.run.smithi130.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-04-13T02:42:17.721 INFO:teuthology.orchestra.run.smithi130.stdout:(68/174): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-13T02:42:17.788 INFO:teuthology.orchestra.run.smithi130.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-13T02:42:17.847 INFO:teuthology.orchestra.run.smithi130.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 27 MB/s | 4.1 MB 00:00 2024-04-13T02:42:17.914 INFO:teuthology.orchestra.run.smithi130.stdout:(71/174): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-04-13T02:42:17.939 INFO:teuthology.orchestra.run.smithi130.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-13T02:42:17.973 INFO:teuthology.orchestra.run.smithi130.stdout:(73/174): postgresql-contrib-13.14-1.el9.x86_64 4.8 MB/s | 911 kB 00:00 2024-04-13T02:42:18.015 INFO:teuthology.orchestra.run.smithi130.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-04-13T02:42:18.040 INFO:teuthology.orchestra.run.smithi130.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-13T02:42:18.082 INFO:teuthology.orchestra.run.smithi130.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-04-13T02:42:18.157 INFO:teuthology.orchestra.run.smithi130.stdout:(77/174): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-04-13T02:42:18.199 INFO:teuthology.orchestra.run.smithi130.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-04-13T02:42:18.224 INFO:teuthology.orchestra.run.smithi130.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-04-13T02:42:18.266 INFO:teuthology.orchestra.run.smithi130.stdout:(80/174): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-04-13T02:42:18.292 INFO:teuthology.orchestra.run.smithi130.stdout:(81/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-13T02:42:18.317 INFO:teuthology.orchestra.run.smithi130.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-04-13T02:42:18.392 INFO:teuthology.orchestra.run.smithi130.stdout:(83/174): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-13T02:42:18.417 INFO:teuthology.orchestra.run.smithi130.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-13T02:42:18.443 INFO:teuthology.orchestra.run.smithi130.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-04-13T02:42:18.468 INFO:teuthology.orchestra.run.smithi130.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-13T02:42:18.493 INFO:teuthology.orchestra.run.smithi130.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-04-13T02:42:18.519 INFO:teuthology.orchestra.run.smithi130.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-13T02:42:18.552 INFO:teuthology.orchestra.run.smithi130.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-04-13T02:42:18.586 INFO:teuthology.orchestra.run.smithi130.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-13T02:42:18.611 INFO:teuthology.orchestra.run.smithi130.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-04-13T02:42:18.636 INFO:teuthology.orchestra.run.smithi130.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-13T02:42:18.712 INFO:teuthology.orchestra.run.smithi130.stdout:(93/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-13T02:42:18.729 INFO:teuthology.orchestra.run.smithi130.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-04-13T02:42:18.745 INFO:teuthology.orchestra.run.smithi130.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-04-13T02:42:18.771 INFO:teuthology.orchestra.run.smithi130.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-04-13T02:42:18.788 INFO:teuthology.orchestra.run.smithi130.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 861 kB/s | 36 kB 00:00 2024-04-13T02:42:18.804 INFO:teuthology.orchestra.run.smithi130.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-13T02:42:18.847 INFO:teuthology.orchestra.run.smithi130.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-13T02:42:18.864 INFO:teuthology.orchestra.run.smithi130.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-04-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi130.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-04-13T02:42:18.906 INFO:teuthology.orchestra.run.smithi130.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-13T02:42:18.923 INFO:teuthology.orchestra.run.smithi130.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-13T02:42:19.007 INFO:teuthology.orchestra.run.smithi130.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-04-13T02:42:19.174 INFO:teuthology.orchestra.run.smithi130.stdout:(105/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-04-13T02:42:19.274 INFO:teuthology.orchestra.run.smithi130.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-04-13T02:42:19.421 INFO:teuthology.orchestra.run.smithi114.stdout:(10/174): ceph-test-19.0.0-2879.g324baf8d.el9.x 20 MB/s | 49 MB 00:02 2024-04-13T02:42:19.472 INFO:teuthology.orchestra.run.smithi114.stdout:(11/174): cephfs-mirror-19.0.0-2879.g324baf8d.e 4.4 MB/s | 224 kB 00:00 2024-04-13T02:42:19.506 INFO:teuthology.orchestra.run.smithi114.stdout:(12/174): cephfs-shell-19.0.0-2879.g324baf8d.el 817 kB/s | 27 kB 00:00 2024-04-13T02:42:19.539 INFO:teuthology.orchestra.run.smithi114.stdout:(13/174): libcephfs-devel-19.0.0-2879.g324baf8d 950 kB/s | 32 kB 00:00 2024-04-13T02:42:19.566 INFO:teuthology.orchestra.run.smithi130.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 67 kB/s | 19 kB 00:00 2024-04-13T02:42:19.606 INFO:teuthology.orchestra.run.smithi114.stdout:(14/174): libcephfs2-19.0.0-2879.g324baf8d.el9. 11 MB/s | 746 kB 00:00 2024-04-13T02:42:19.656 INFO:teuthology.orchestra.run.smithi114.stdout:(15/174): libcephsqlite-19.0.0-2879.g324baf8d.e 3.2 MB/s | 164 kB 00:00 2024-04-13T02:42:19.698 INFO:teuthology.orchestra.run.smithi114.stdout:(16/174): librados-devel-19.0.0-2879.g324baf8d. 3.0 MB/s | 127 kB 00:00 2024-04-13T02:42:19.765 INFO:teuthology.orchestra.run.smithi114.stdout:(17/174): libradosstriper1-19.0.0-2879.g324baf8 7.3 MB/s | 500 kB 00:00 2024-04-13T02:42:19.849 INFO:teuthology.orchestra.run.smithi130.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 458 kB/s | 309 kB 00:00 2024-04-13T02:42:19.874 INFO:teuthology.orchestra.run.smithi130.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 632 kB/s | 548 kB 00:00 2024-04-13T02:42:19.966 INFO:teuthology.orchestra.run.smithi130.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-04-13T02:42:19.992 INFO:teuthology.orchestra.run.smithi130.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-04-13T02:42:20.092 INFO:teuthology.orchestra.run.smithi130.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 537 kB/s | 67 kB 00:00 2024-04-13T02:42:20.098 INFO:teuthology.orchestra.run.smithi114.stdout:(18/174): librgw2-19.0.0-2879.g324baf8d.el9.x86 16 MB/s | 5.2 MB 00:00 2024-04-13T02:42:20.109 INFO:teuthology.orchestra.run.smithi130.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-13T02:42:20.149 INFO:teuthology.orchestra.run.smithi114.stdout:(19/174): python3-ceph-argparse-19.0.0-2879.g32 904 kB/s | 45 kB 00:00 2024-04-13T02:42:20.199 INFO:teuthology.orchestra.run.smithi114.stdout:(20/174): python3-ceph-common-19.0.0-2879.g324b 2.6 MB/s | 135 kB 00:00 2024-04-13T02:42:20.249 INFO:teuthology.orchestra.run.smithi114.stdout:(21/174): python3-cephfs-19.0.0-2879.g324baf8d. 3.2 MB/s | 161 kB 00:00 2024-04-13T02:42:20.308 INFO:teuthology.orchestra.run.smithi114.stdout:(22/174): python3-rados-19.0.0-2879.g324baf8d.e 5.4 MB/s | 320 kB 00:00 2024-04-13T02:42:20.317 INFO:teuthology.orchestra.run.smithi130.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-04-13T02:42:20.383 INFO:teuthology.orchestra.run.smithi114.stdout:(23/174): python3-rbd-19.0.0-2879.g324baf8d.el9 3.9 MB/s | 297 kB 00:00 2024-04-13T02:42:20.401 INFO:teuthology.orchestra.run.smithi130.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.7 MB/s | 838 kB 00:00 2024-04-13T02:42:20.433 INFO:teuthology.orchestra.run.smithi114.stdout:(24/174): python3-rgw-19.0.0-2879.g324baf8d.el9 1.9 MB/s | 99 kB 00:00 2024-04-13T02:42:20.435 INFO:teuthology.orchestra.run.smithi130.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 372 kB/s | 43 kB 00:00 2024-04-13T02:42:20.484 INFO:teuthology.orchestra.run.smithi114.stdout:(25/174): rbd-fuse-19.0.0-2879.g324baf8d.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-13T02:42:20.518 INFO:teuthology.orchestra.run.smithi130.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2024-04-13T02:42:20.552 INFO:teuthology.orchestra.run.smithi130.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-04-13T02:42:20.627 INFO:teuthology.orchestra.run.smithi130.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-13T02:42:20.667 INFO:teuthology.orchestra.run.smithi114.stdout:(26/174): rbd-mirror-19.0.0-2879.g324baf8d.el9. 17 MB/s | 3.1 MB 00:00 2024-04-13T02:42:20.677 INFO:teuthology.orchestra.run.smithi130.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-13T02:42:20.769 INFO:teuthology.orchestra.run.smithi130.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-04-13T02:42:20.794 INFO:teuthology.orchestra.run.smithi130.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2024-04-13T02:42:20.826 INFO:teuthology.orchestra.run.smithi114.stdout:(27/174): ceph-osd-19.0.0-2879.g324baf8d.el9.x8 3.6 MB/s | 17 MB 00:04 2024-04-13T02:42:20.851 INFO:teuthology.orchestra.run.smithi114.stdout:(28/174): rbd-nbd-19.0.0-2879.g324baf8d.el9.x86 932 kB/s | 171 kB 00:00 2024-04-13T02:42:20.877 INFO:teuthology.orchestra.run.smithi114.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2879.g 685 kB/s | 34 kB 00:00 2024-04-13T02:42:20.895 INFO:teuthology.orchestra.run.smithi130.stdout:(123/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-04-13T02:42:20.902 INFO:teuthology.orchestra.run.smithi114.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2879.g324baf8 2.8 MB/s | 142 kB 00:00 2024-04-13T02:42:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.3 MB/s | 203 kB 00:00 2024-04-13T02:42:21.012 INFO:teuthology.orchestra.run.smithi130.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-13T02:42:21.037 INFO:teuthology.orchestra.run.smithi130.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 91 kB/s | 11 kB 00:00 2024-04-13T02:42:21.129 INFO:teuthology.orchestra.run.smithi130.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-04-13T02:42:21.154 INFO:teuthology.orchestra.run.smithi130.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-04-13T02:42:21.246 INFO:teuthology.orchestra.run.smithi130.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-04-13T02:42:21.280 INFO:teuthology.orchestra.run.smithi130.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 156 kB/s | 20 kB 00:00 2024-04-13T02:42:21.302 INFO:teuthology.orchestra.run.smithi114.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 19 MB/s | 7.4 MB 00:00 2024-04-13T02:42:21.331 INFO:teuthology.orchestra.run.smithi130.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-04-13T02:42:21.361 INFO:teuthology.orchestra.run.smithi114.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2879.g32 4.2 MB/s | 249 kB 00:00 2024-04-13T02:42:21.398 INFO:teuthology.orchestra.run.smithi130.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-04-13T02:42:21.402 INFO:teuthology.orchestra.run.smithi114.stdout:(33/174): ceph-mgr-rook-19.0.0-2879.g324baf8d.e 1.2 MB/s | 49 kB 00:00 2024-04-13T02:42:21.444 INFO:teuthology.orchestra.run.smithi114.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2879.g3 396 kB/s | 16 kB 00:00 2024-04-13T02:42:21.448 INFO:teuthology.orchestra.run.smithi130.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 673 kB/s | 79 kB 00:00 2024-04-13T02:42:21.503 INFO:teuthology.orchestra.run.smithi114.stdout:(35/174): ceph-volume-19.0.0-2879.g324baf8d.el9 4.4 MB/s | 264 kB 00:00 2024-04-13T02:42:21.515 INFO:teuthology.orchestra.run.smithi130.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 494 kB/s | 58 kB 00:00 2024-04-13T02:42:21.550 INFO:teuthology.orchestra.run.smithi130.stdout:(135/174): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-04-13T02:42:21.574 INFO:teuthology.orchestra.run.smithi130.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-13T02:42:21.586 INFO:teuthology.orchestra.run.smithi114.stdout:(36/174): cephadm-19.0.0-2879.g324baf8d.el9.noa 9.0 MB/s | 762 kB 00:00 2024-04-13T02:42:21.624 INFO:teuthology.orchestra.run.smithi130.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-04-13T02:42:21.665 INFO:teuthology.orchestra.run.smithi114.stdout:(37/174): ceph-mgr-dashboard-19.0.0-2879.g324ba 4.5 MB/s | 3.5 MB 00:00 2024-04-13T02:42:21.665 INFO:teuthology.orchestra.run.smithi130.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 768 kB/s | 90 kB 00:00 2024-04-13T02:42:21.689 INFO:teuthology.orchestra.run.smithi114.stdout:(38/174): cephfs-top-19.0.0-2879.g324baf8d.el9. 178 kB/s | 18 kB 00:00 2024-04-13T02:42:21.699 INFO:teuthology.orchestra.run.smithi130.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-04-13T02:42:21.741 INFO:teuthology.orchestra.run.smithi130.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2024-04-13T02:42:21.781 INFO:teuthology.orchestra.run.smithi114.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 151 kB/s | 18 kB 00:00 2024-04-13T02:42:21.783 INFO:teuthology.orchestra.run.smithi130.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-13T02:42:21.807 INFO:teuthology.orchestra.run.smithi114.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 688 kB/s | 80 kB 00:00 2024-04-13T02:42:21.817 INFO:teuthology.orchestra.run.smithi130.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-04-13T02:42:21.859 INFO:teuthology.orchestra.run.smithi130.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2024-04-13T02:42:21.865 INFO:teuthology.orchestra.run.smithi114.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-04-13T02:42:21.901 INFO:teuthology.orchestra.run.smithi130.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 435 kB/s | 51 kB 00:00 2024-04-13T02:42:21.916 INFO:teuthology.orchestra.run.smithi114.stdout:(42/174): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-04-13T02:42:21.934 INFO:teuthology.orchestra.run.smithi130.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-13T02:42:21.958 INFO:teuthology.orchestra.run.smithi114.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-13T02:42:21.976 INFO:teuthology.orchestra.run.smithi130.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 765 kB/s | 90 kB 00:00 2024-04-13T02:42:22.033 INFO:teuthology.orchestra.run.smithi114.stdout:(44/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-13T02:42:22.035 INFO:teuthology.orchestra.run.smithi130.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-13T02:42:22.052 INFO:teuthology.orchestra.run.smithi130.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-04-13T02:42:22.058 INFO:teuthology.orchestra.run.smithi114.stdout:(45/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.5 MB/s | 218 kB 00:00 2024-04-13T02:42:22.094 INFO:teuthology.orchestra.run.smithi130.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-13T02:42:22.125 INFO:teuthology.orchestra.run.smithi114.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-13T02:42:22.175 INFO:teuthology.orchestra.run.smithi114.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-04-13T02:42:22.217 INFO:teuthology.orchestra.run.smithi114.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-13T02:42:22.260 INFO:teuthology.orchestra.run.smithi114.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-13T02:42:22.318 INFO:teuthology.orchestra.run.smithi114.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-04-13T02:42:22.353 INFO:teuthology.orchestra.run.smithi130.stdout:(150/174): librados2-19.0.0-2879.g324baf8d.el9. 11 MB/s | 3.4 MB 00:00 2024-04-13T02:42:22.428 INFO:teuthology.orchestra.run.smithi130.stdout:(151/174): thrift-0.15.0-2.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-04-13T02:42:22.527 INFO:teuthology.orchestra.run.smithi114.stdout:(51/174): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-04-13T02:42:22.569 INFO:teuthology.orchestra.run.smithi130.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-04-13T02:42:22.611 INFO:teuthology.orchestra.run.smithi130.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-04-13T02:42:22.653 INFO:teuthology.orchestra.run.smithi130.stdout:(154/174): NetworkManager-libnm-1.47.4-1.el9.x8 8.1 MB/s | 1.8 MB 00:00 2024-04-13T02:42:22.679 INFO:teuthology.orchestra.run.smithi130.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-04-13T02:42:22.712 INFO:teuthology.orchestra.run.smithi130.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-04-13T02:42:22.735 INFO:teuthology.orchestra.run.smithi114.stdout:(52/174): ceph-common-19.0.0-2879.g324baf8d.el9 2.2 MB/s | 21 MB 00:09 2024-04-13T02:42:22.754 INFO:teuthology.orchestra.run.smithi130.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 485 kB/s | 36 kB 00:00 2024-04-13T02:42:22.777 INFO:teuthology.orchestra.run.smithi114.stdout:(53/174): boost-program-options-1.75.0-8.el9.x8 427 kB/s | 107 kB 00:00 2024-04-13T02:42:22.779 INFO:teuthology.orchestra.run.smithi130.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-13T02:42:22.805 INFO:teuthology.orchestra.run.smithi130.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-04-13T02:42:22.827 INFO:teuthology.orchestra.run.smithi114.stdout:(54/174): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-04-13T02:42:22.830 INFO:teuthology.orchestra.run.smithi130.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 458 kB/s | 23 kB 00:00 2024-04-13T02:42:22.872 INFO:teuthology.orchestra.run.smithi130.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-04-13T02:42:22.877 INFO:teuthology.orchestra.run.smithi114.stdout:(55/174): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-13T02:42:22.894 INFO:teuthology.orchestra.run.smithi114.stdout:(56/174): elfutils-libelf-devel-0.190-2.el9.x86 135 kB/s | 21 kB 00:00 2024-04-13T02:42:22.897 INFO:teuthology.orchestra.run.smithi130.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-04-13T02:42:22.919 INFO:teuthology.orchestra.run.smithi114.stdout:(57/174): flexiblas-3.0.4-8.el9.x86_64.rpm 359 kB/s | 33 kB 00:00 2024-04-13T02:42:22.922 INFO:teuthology.orchestra.run.smithi130.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-04-13T02:42:22.948 INFO:teuthology.orchestra.run.smithi130.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-04-13T02:42:22.970 INFO:teuthology.orchestra.run.smithi114.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-04-13T02:42:22.973 INFO:teuthology.orchestra.run.smithi130.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 574 kB/s | 29 kB 00:00 2024-04-13T02:42:23.007 INFO:teuthology.orchestra.run.smithi130.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2024-04-13T02:42:23.037 INFO:teuthology.orchestra.run.smithi114.stdout:(59/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-04-13T02:42:23.062 INFO:teuthology.orchestra.run.smithi114.stdout:(60/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-04-13T02:42:23.079 INFO:teuthology.orchestra.run.smithi114.stdout:(61/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 415 kB/s | 45 kB 00:00 2024-04-13T02:42:23.082 INFO:teuthology.orchestra.run.smithi130.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 20 MB/s | 2.2 MB 00:00 2024-04-13T02:42:23.129 INFO:teuthology.orchestra.run.smithi114.stdout:(62/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-04-13T02:42:23.132 INFO:teuthology.orchestra.run.smithi130.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 18 MB/s | 2.3 MB 00:00 2024-04-13T02:42:23.146 INFO:teuthology.orchestra.run.smithi114.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 380 kB/s | 25 kB 00:00 2024-04-13T02:42:23.166 INFO:teuthology.orchestra.run.smithi130.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 465 kB 00:00 2024-04-13T02:42:23.180 INFO:teuthology.orchestra.run.smithi114.stdout:(64/174): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-04-13T02:42:23.191 INFO:teuthology.orchestra.run.smithi130.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 533 kB/s | 31 kB 00:00 2024-04-13T02:42:23.198 INFO:teuthology.orchestra.run.smithi114.stdout:(65/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-04-13T02:42:23.216 INFO:teuthology.orchestra.run.smithi130.stdout:(171/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2024-04-13T02:42:23.231 INFO:teuthology.orchestra.run.smithi114.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-13T02:42:23.256 INFO:teuthology.orchestra.run.smithi114.stdout:(67/174): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-13T02:42:23.258 INFO:teuthology.orchestra.run.smithi130.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-04-13T02:42:23.273 INFO:teuthology.orchestra.run.smithi114.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 464 kB/s | 35 kB 00:00 2024-04-13T02:42:23.325 INFO:teuthology.orchestra.run.smithi130.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 685 kB/s | 74 kB 00:00 2024-04-13T02:42:23.423 INFO:teuthology.orchestra.run.smithi114.stdout:(69/174): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-04-13T02:42:23.490 INFO:teuthology.orchestra.run.smithi114.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 4.1 MB 00:00 2024-04-13T02:42:23.549 INFO:teuthology.orchestra.run.smithi114.stdout:(71/174): postgresql-13.14-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-04-13T02:42:23.574 INFO:teuthology.orchestra.run.smithi114.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-13T02:42:23.607 INFO:teuthology.orchestra.run.smithi114.stdout:(73/174): postgresql-contrib-13.14-1.el9.x86_64 4.8 MB/s | 911 kB 00:00 2024-04-13T02:42:23.667 INFO:teuthology.orchestra.run.smithi130.stdout:(174/174): librbd1-19.0.0-2879.g324baf8d.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-04-13T02:42:23.670 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-04-13T02:42:23.670 INFO:teuthology.orchestra.run.smithi130.stdout:Total 17 MB/s | 229 MB 00:13 2024-04-13T02:42:23.691 INFO:teuthology.orchestra.run.smithi114.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-04-13T02:42:23.716 INFO:teuthology.orchestra.run.smithi114.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 805 kB/s | 87 kB 00:00 2024-04-13T02:42:23.810 INFO:teuthology.orchestra.run.smithi114.stdout:(76/174): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-13T02:42:23.859 INFO:teuthology.orchestra.run.smithi114.stdout:(77/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-04-13T02:42:23.884 INFO:teuthology.orchestra.run.smithi114.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-04-13T02:42:23.968 INFO:teuthology.orchestra.run.smithi114.stdout:(79/174): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-13T02:42:23.993 INFO:teuthology.orchestra.run.smithi114.stdout:(80/174): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-04-13T02:42:24.018 INFO:teuthology.orchestra.run.smithi114.stdout:(81/174): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-04-13T02:42:24.043 INFO:teuthology.orchestra.run.smithi114.stdout:(82/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-13T02:42:24.068 INFO:teuthology.orchestra.run.smithi114.stdout:(83/174): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-04-13T02:42:24.119 INFO:teuthology.orchestra.run.smithi114.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-13T02:42:24.186 INFO:teuthology.orchestra.run.smithi114.stdout:(85/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 5.1 MB 00:00 2024-04-13T02:42:24.211 INFO:teuthology.orchestra.run.smithi114.stdout:(86/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-13T02:42:24.236 INFO:teuthology.orchestra.run.smithi114.stdout:(87/174): python3-packaging-20.9-5.el9.noarch.r 658 kB/s | 77 kB 00:00 2024-04-13T02:42:24.262 INFO:teuthology.orchestra.run.smithi114.stdout:(88/174): python3-prettytable-0.7.2-27.el9.noar 560 kB/s | 42 kB 00:00 2024-04-13T02:42:24.287 INFO:teuthology.orchestra.run.smithi114.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-13T02:42:24.320 INFO:teuthology.orchestra.run.smithi114.stdout:(90/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-04-13T02:42:24.346 INFO:teuthology.orchestra.run.smithi114.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-04-13T02:42:24.363 INFO:teuthology.orchestra.run.smithi114.stdout:(92/174): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-04-13T02:42:24.380 INFO:teuthology.orchestra.run.smithi114.stdout:(93/174): python3-requests-oauthlib-1.3.0-12.el 910 kB/s | 54 kB 00:00 2024-04-13T02:42:24.430 INFO:teuthology.orchestra.run.smithi114.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-04-13T02:42:24.463 INFO:teuthology.orchestra.run.smithi114.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-04-13T02:42:24.514 INFO:teuthology.orchestra.run.smithi114.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-13T02:42:24.539 INFO:teuthology.orchestra.run.smithi114.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 475 kB/s | 36 kB 00:00 2024-04-13T02:42:24.573 INFO:teuthology.orchestra.run.smithi114.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-04-13T02:42:24.623 INFO:teuthology.orchestra.run.smithi114.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-13T02:42:24.640 INFO:teuthology.orchestra.run.smithi114.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-04-13T02:42:24.799 INFO:teuthology.orchestra.run.smithi114.stdout:(101/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-13T02:42:24.824 INFO:teuthology.orchestra.run.smithi114.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 468 kB/s | 94 kB 00:00 2024-04-13T02:42:24.841 INFO:teuthology.orchestra.run.smithi114.stdout:(103/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-04-13T02:42:24.858 INFO:teuthology.orchestra.run.smithi114.stdout:(104/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-04-13T02:42:24.916 INFO:teuthology.orchestra.run.smithi114.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-04-13T02:42:25.024 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-04-13T02:42:25.160 INFO:teuthology.orchestra.run.smithi114.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-04-13T02:42:25.307 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-04-13T02:42:25.307 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-04-13T02:42:25.534 INFO:teuthology.orchestra.run.smithi114.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 52 kB/s | 19 kB 00:00 2024-04-13T02:42:25.592 INFO:teuthology.orchestra.run.smithi114.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 746 kB/s | 548 kB 00:00 2024-04-13T02:42:25.634 INFO:teuthology.orchestra.run.smithi114.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 430 kB/s | 309 kB 00:00 2024-04-13T02:42:25.693 INFO:teuthology.orchestra.run.smithi114.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-13T02:42:25.752 INFO:teuthology.orchestra.run.smithi114.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-04-13T02:42:25.802 INFO:teuthology.orchestra.run.smithi114.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-04-13T02:42:25.902 INFO:teuthology.orchestra.run.smithi114.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-13T02:42:26.011 INFO:teuthology.orchestra.run.smithi114.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-04-13T02:42:26.119 INFO:teuthology.orchestra.run.smithi114.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 402 kB/s | 43 kB 00:00 2024-04-13T02:42:26.145 INFO:teuthology.orchestra.run.smithi114.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-04-13T02:42:26.228 INFO:teuthology.orchestra.run.smithi114.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 296 kB/s | 32 kB 00:00 2024-04-13T02:42:26.254 INFO:teuthology.orchestra.run.smithi114.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-04-13T02:42:26.320 INFO:teuthology.orchestra.run.smithi114.stdout:(119/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-04-13T02:42:26.345 INFO:teuthology.orchestra.run.smithi114.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-13T02:42:26.396 INFO:teuthology.orchestra.run.smithi114.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-04-13T02:42:26.430 INFO:teuthology.orchestra.run.smithi114.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-13T02:42:26.455 INFO:teuthology.orchestra.run.smithi114.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 324 kB/s | 35 kB 00:00 2024-04-13T02:42:26.522 INFO:teuthology.orchestra.run.smithi114.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-04-13T02:42:26.589 INFO:teuthology.orchestra.run.smithi114.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-04-13T02:42:26.614 INFO:teuthology.orchestra.run.smithi114.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 909 kB/s | 144 kB 00:00 2024-04-13T02:42:26.648 INFO:teuthology.orchestra.run.smithi114.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-13T02:42:26.698 INFO:teuthology.orchestra.run.smithi114.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-13T02:42:26.723 INFO:teuthology.orchestra.run.smithi114.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 212 kB/s | 23 kB 00:00 2024-04-13T02:42:26.757 INFO:teuthology.orchestra.run.smithi114.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-04-13T02:42:26.807 INFO:teuthology.orchestra.run.smithi114.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-13T02:42:26.866 INFO:teuthology.orchestra.run.smithi114.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-04-13T02:42:26.899 INFO:teuthology.orchestra.run.smithi114.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-04-13T02:42:26.916 INFO:teuthology.orchestra.run.smithi114.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 725 kB/s | 79 kB 00:00 2024-04-13T02:42:26.975 INFO:teuthology.orchestra.run.smithi114.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 531 kB/s | 58 kB 00:00 2024-04-13T02:42:27.017 INFO:teuthology.orchestra.run.smithi114.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-13T02:42:27.042 INFO:teuthology.orchestra.run.smithi114.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-04-13T02:42:27.092 INFO:teuthology.orchestra.run.smithi114.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2024-04-13T02:42:27.118 INFO:teuthology.orchestra.run.smithi114.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-04-13T02:42:27.151 INFO:teuthology.orchestra.run.smithi114.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-04-13T02:42:27.218 INFO:teuthology.orchestra.run.smithi114.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-04-13T02:42:27.243 INFO:teuthology.orchestra.run.smithi114.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 470 kB/s | 59 kB 00:00 2024-04-13T02:42:27.260 INFO:teuthology.orchestra.run.smithi114.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-04-13T02:42:27.327 INFO:teuthology.orchestra.run.smithi114.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 468 kB/s | 51 kB 00:00 2024-04-13T02:42:27.361 INFO:teuthology.orchestra.run.smithi114.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-13T02:42:27.386 INFO:teuthology.orchestra.run.smithi114.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 714 kB/s | 90 kB 00:00 2024-04-13T02:42:27.465 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-04-13T02:42:27.465 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-04-13T02:42:27.469 INFO:teuthology.orchestra.run.smithi114.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-04-13T02:42:27.495 INFO:teuthology.orchestra.run.smithi114.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-04-13T02:42:27.520 INFO:teuthology.orchestra.run.smithi114.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-13T02:42:27.654 INFO:teuthology.orchestra.run.smithi114.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi114.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-04-13T02:42:27.904 INFO:teuthology.orchestra.run.smithi114.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 16 MB/s | 1.8 MB 00:00 2024-04-13T02:42:27.955 INFO:teuthology.orchestra.run.smithi114.stdout:(153/174): librbd1-19.0.0-2879.g324baf8d.el9.x8 7.2 MB/s | 3.1 MB 00:00 2024-04-13T02:42:28.005 INFO:teuthology.orchestra.run.smithi114.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 418 kB/s | 42 kB 00:00 2024-04-13T02:42:28.055 INFO:teuthology.orchestra.run.smithi114.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-04-13T02:42:28.080 INFO:teuthology.orchestra.run.smithi114.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 948 kB/s | 71 kB 00:00 2024-04-13T02:42:28.122 INFO:teuthology.orchestra.run.smithi114.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 544 kB/s | 36 kB 00:00 2024-04-13T02:42:28.173 INFO:teuthology.orchestra.run.smithi114.stdout:(158/174): librados2-19.0.0-2879.g324baf8d.el9. 5.0 MB/s | 3.4 MB 00:00 2024-04-13T02:42:28.223 INFO:teuthology.orchestra.run.smithi114.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.3 MB/s | 192 kB 00:00 2024-04-13T02:42:28.248 INFO:teuthology.orchestra.run.smithi114.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 306 kB/s | 23 kB 00:00 2024-04-13T02:42:28.290 INFO:teuthology.orchestra.run.smithi114.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.5 MB/s | 256 kB 00:00 2024-04-13T02:42:28.332 INFO:teuthology.orchestra.run.smithi114.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-04-13T02:42:28.358 INFO:teuthology.orchestra.run.smithi114.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 808 kB/s | 108 kB 00:00 2024-04-13T02:42:28.399 INFO:teuthology.orchestra.run.smithi114.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 136 kB 00:00 2024-04-13T02:42:28.442 INFO:teuthology.orchestra.run.smithi114.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 587 kB/s | 64 kB 00:00 2024-04-13T02:42:28.467 INFO:teuthology.orchestra.run.smithi114.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 264 kB/s | 29 kB 00:00 2024-04-13T02:42:28.550 INFO:teuthology.orchestra.run.smithi114.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 8.0 MB/s | 1.2 MB 00:00 2024-04-13T02:42:28.634 INFO:teuthology.orchestra.run.smithi114.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-04-13T02:42:28.692 INFO:teuthology.orchestra.run.smithi114.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 10 MB/s | 2.3 MB 00:00 2024-04-13T02:42:28.718 INFO:teuthology.orchestra.run.smithi114.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 2.7 MB/s | 465 kB 00:00 2024-04-13T02:42:28.743 INFO:teuthology.orchestra.run.smithi114.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 286 kB/s | 31 kB 00:00 2024-04-13T02:42:28.793 INFO:teuthology.orchestra.run.smithi114.stdout:(172/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2024-04-13T02:42:28.835 INFO:teuthology.orchestra.run.smithi114.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 810 kB/s | 74 kB 00:00 2024-04-13T02:42:28.869 INFO:teuthology.orchestra.run.smithi114.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.1 MB/s | 1.1 MB 00:00 2024-04-13T02:42:28.875 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-13T02:42:28.875 INFO:teuthology.orchestra.run.smithi114.stdout:Total 14 MB/s | 229 MB 00:16 2024-04-13T02:42:30.180 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-13T02:42:30.463 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-13T02:42:30.463 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-13T02:42:32.624 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-13T02:42:32.624 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-13T02:42:34.780 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-04-13T02:42:34.872 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-13T02:42:34.898 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-13T02:42:34.937 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-13T02:42:34.946 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-13T02:42:34.994 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-13T02:42:35.048 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-13T02:42:35.081 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-13T02:42:35.104 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-13T02:42:35.153 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-13T02:42:35.490 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-13T02:42:35.539 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-13T02:42:35.643 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-13T02:42:35.673 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-13T02:42:35.765 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-13T02:42:35.803 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-13T02:42:35.841 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-13T02:42:36.019 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-13T02:42:36.077 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-13T02:42:36.103 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-13T02:42:36.212 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-13T02:42:36.238 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-13T02:42:36.303 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-13T02:42:36.350 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-13T02:42:36.374 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-13T02:42:36.390 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-13T02:42:36.582 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-13T02:42:36.615 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-13T02:42:36.653 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-13T02:42:36.844 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-13T02:42:36.989 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-13T02:42:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-13T02:42:37.118 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-13T02:42:37.167 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-13T02:42:37.384 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-13T02:42:37.488 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-13T02:42:37.577 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-13T02:42:37.615 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-13T02:42:37.649 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-13T02:42:37.713 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-13T02:42:37.748 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-13T02:42:37.792 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-13T02:42:37.824 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-13T02:42:37.852 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-13T02:42:37.921 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-13T02:42:37.983 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-13T02:42:38.014 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-13T02:42:38.068 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-13T02:42:38.142 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-13T02:42:38.176 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 39/198 2024-04-13T02:42:38.220 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 40/198 2024-04-13T02:42:38.248 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 41/198 2024-04-13T02:42:38.334 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-13T02:42:38.388 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-13T02:42:38.462 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-13T02:42:38.598 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-13T02:42:38.648 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-13T02:42:39.166 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-13T02:42:39.254 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-13T02:42:39.369 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-13T02:42:39.415 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-13T02:42:39.425 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-13T02:42:39.456 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-13T02:42:39.496 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-13T02:42:39.533 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 53/198 2024-04-13T02:42:39.564 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-13T02:42:39.776 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-13T02:42:39.848 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-13T02:42:39.881 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-13T02:42:39.907 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-13T02:42:39.987 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-13T02:42:39.995 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-13T02:42:40.029 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-13T02:42:40.074 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-13T02:42:40.117 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-13T02:42:40.192 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-13T02:42:40.326 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-13T02:42:40.375 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-13T02:42:40.400 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-13T02:42:40.455 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-13T02:42:40.491 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-13T02:42:40.555 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-13T02:42:40.612 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-13T02:42:40.692 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-13T02:42:40.729 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-13T02:42:40.766 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-13T02:42:40.786 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-13T02:42:40.813 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-13T02:42:40.842 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-13T02:42:40.848 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-13T02:42:40.891 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-13T02:42:40.934 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-13T02:42:40.966 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-13T02:42:40.993 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-13T02:42:41.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-13T02:42:41.066 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-13T02:42:41.097 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-13T02:42:41.113 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-13T02:42:41.144 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-13T02:42:41.144 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-13T02:42:41.185 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-13T02:42:41.279 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-13T02:42:41.318 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-13T02:42:41.332 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-13T02:42:41.400 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-13T02:42:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-13T02:42:41.400 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-13T02:42:41.407 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-13T02:42:41.409 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-13T02:42:41.487 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-13T02:42:41.515 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-13T02:42:41.540 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-13T02:42:41.606 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-13T02:42:41.608 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-13T02:42:41.641 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-13T02:42:41.645 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-13T02:42:41.667 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-13T02:42:41.668 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-13T02:42:41.683 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-13T02:42:41.711 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-13T02:42:41.750 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-13T02:42:41.781 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-13T02:42:41.820 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-13T02:42:41.854 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-13T02:42:41.875 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-13T02:42:41.887 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-13T02:42:41.907 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-13T02:42:41.928 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-13T02:42:41.951 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-13T02:42:41.963 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-13T02:42:42.049 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-13T02:42:42.101 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-13T02:42:42.133 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-13T02:42:42.143 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-13T02:42:42.180 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-13T02:42:42.267 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-13T02:42:42.277 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-13T02:42:42.328 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-13T02:42:42.337 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-13T02:42:42.438 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-13T02:42:42.504 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-13T02:42:42.714 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-13T02:42:42.816 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-13T02:42:42.903 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-13T02:42:42.960 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-13T02:42:43.001 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-13T02:42:43.053 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-13T02:42:43.064 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-13T02:42:43.101 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-13T02:42:43.106 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-13T02:42:43.140 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-13T02:42:43.144 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-13T02:42:43.177 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-13T02:42:43.213 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-13T02:42:43.240 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-13T02:42:43.281 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-13T02:42:43.288 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-13T02:42:43.335 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-13T02:42:43.375 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-13T02:42:43.377 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-13T02:42:43.416 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-13T02:42:43.419 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-13T02:42:43.493 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-13T02:42:43.529 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 39/198 2024-04-13T02:42:43.573 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 40/198 2024-04-13T02:42:43.593 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-13T02:42:43.601 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 41/198 2024-04-13T02:42:43.623 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-13T02:42:43.671 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-13T02:42:43.700 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-13T02:42:43.715 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-13T02:42:43.789 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-13T02:42:43.933 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-13T02:42:44.002 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-13T02:42:44.346 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-13T02:42:44.466 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-13T02:42:44.514 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-13T02:42:44.596 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-13T02:42:44.674 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-13T02:42:44.725 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-13T02:42:44.734 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-13T02:42:44.766 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-13T02:42:44.822 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-13T02:42:44.860 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 53/198 2024-04-13T02:42:44.891 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-13T02:42:45.180 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-13T02:42:45.346 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-13T02:42:45.426 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-13T02:42:45.462 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-13T02:42:45.606 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-13T02:42:45.648 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-13T02:42:45.676 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-13T02:42:45.702 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-13T02:42:45.766 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-13T02:42:45.772 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-13T02:42:45.798 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-13T02:42:45.799 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-13T02:42:45.835 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-13T02:42:45.907 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-13T02:42:45.951 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-13T02:42:45.994 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-13T02:42:46.037 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-13T02:42:46.109 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-13T02:42:46.136 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-13T02:42:46.169 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-13T02:42:46.209 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-13T02:42:46.226 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-13T02:42:46.239 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-13T02:42:46.258 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 113/198 2024-04-13T02:42:46.280 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-13T02:42:46.294 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-13T02:42:46.374 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-13T02:42:46.422 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-13T02:42:46.465 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-13T02:42:46.488 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-13T02:42:46.513 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-13T02:42:46.592 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-13T02:42:46.721 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-13T02:42:46.753 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-13T02:42:46.762 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-13T02:42:46.781 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-13T02:42:46.789 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-13T02:42:46.816 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-13T02:42:46.855 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-13T02:42:46.860 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-13T02:42:46.882 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 117/198 2024-04-13T02:42:46.888 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-13T02:42:46.918 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-13T02:42:46.953 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-13T02:42:46.986 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-13T02:42:47.027 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-13T02:42:47.062 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-13T02:42:47.148 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-13T02:42:47.192 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-13T02:42:47.223 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-13T02:42:47.270 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-13T02:42:47.366 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-13T02:42:47.416 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-13T02:42:48.132 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-13T02:42:48.189 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-13T02:42:48.222 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-13T02:42:48.320 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-13T02:42:48.372 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-13T02:42:48.459 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-13T02:42:48.508 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-13T02:42:48.685 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-13T02:42:48.714 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-13T02:42:48.800 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-13T02:42:49.139 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-13T02:42:49.170 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-13T02:42:49.436 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-13T02:42:49.544 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-13T02:42:49.722 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-13T02:42:49.773 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-13T02:42:49.857 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-13T02:42:49.857 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-13T02:42:49.857 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-13T02:42:49.857 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:42:49.891 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-13T02:42:50.768 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-13T02:42:50.843 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-13T02:42:50.869 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-13T02:42:51.187 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-13T02:42:51.216 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-13T02:42:51.306 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-13T02:42:51.338 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 113/198 2024-04-13T02:42:51.374 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-13T02:42:51.841 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-13T02:42:51.869 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-13T02:42:51.923 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-13T02:42:51.946 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 117/198 2024-04-13T02:42:54.143 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-13T02:42:54.175 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-13T02:42:54.709 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-13T02:42:54.745 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-13T02:42:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-13T02:42:54.836 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-13T02:42:54.837 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-13T02:42:54.837 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:42:54.872 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-13T02:43:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-13T02:43:01.507 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-04-13T02:43:01.507 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-04-13T02:43:01.508 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-04-13T02:43:01.508 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-04-13T02:43:01.508 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-04-13T02:43:01.508 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-04-13T02:43:01.508 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-04-13T02:43:01.508 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:01.674 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-13T02:43:01.689 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-13T02:43:01.690 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:01.690 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-13T02:43:01.690 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:03.186 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-13T02:43:03.212 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-13T02:43:03.212 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:03.212 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-13T02:43:03.212 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-13T02:43:03.212 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-13T02:43:03.212 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:03.437 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-13T02:43:03.460 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-13T02:43:03.460 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-13T02:43:03.460 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:03.904 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-13T02:43:03.927 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-13T02:43:03.927 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:03.927 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-13T02:43:03.928 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-13T02:43:03.928 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-13T02:43:03.928 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:04.026 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-13T02:43:04.074 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-13T02:43:04.147 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-13T02:43:04.334 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-13T02:43:04.379 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-13T02:43:04.457 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-13T02:43:04.555 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-13T02:43:04.696 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-13T02:43:04.729 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-13T02:43:04.762 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-13T02:43:04.794 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-13T02:43:04.829 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-13T02:43:04.857 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-13T02:43:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-13T02:43:05.313 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-13T02:43:05.370 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 139/198 2024-04-13T02:43:05.431 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 140/198 2024-04-13T02:43:05.461 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-13T02:43:06.504 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-13T02:43:06.546 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-13T02:43:06.834 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-13T02:43:06.834 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-04-13T02:43:06.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:06.991 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-13T02:43:07.006 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-13T02:43:07.006 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:07.006 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-13T02:43:07.006 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:07.514 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-13T02:43:07.547 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-13T02:43:07.649 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-13T02:43:07.810 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 144/198 2024-04-13T02:43:07.840 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-13T02:43:07.864 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-13T02:43:07.864 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:07.864 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-13T02:43:07.864 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-13T02:43:07.864 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-13T02:43:07.864 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:07.908 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-13T02:43:07.918 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-13T02:43:08.017 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 147/198 2024-04-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-13T02:43:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-13T02:43:08.521 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:08.521 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-13T02:43:08.521 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-13T02:43:08.521 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-13T02:43:08.521 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:08.746 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-13T02:43:08.768 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-13T02:43:08.768 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:08.768 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-13T02:43:08.768 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-13T02:43:08.768 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-13T02:43:08.769 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:09.205 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-13T02:43:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-13T02:43:09.227 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:09.227 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-13T02:43:09.227 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-13T02:43:09.227 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-13T02:43:09.227 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:09.335 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-13T02:43:09.384 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-13T02:43:09.446 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-13T02:43:09.640 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-13T02:43:09.690 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-13T02:43:09.767 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-13T02:43:09.855 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-13T02:43:09.986 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-13T02:43:10.030 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-13T02:43:10.063 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-13T02:43:10.103 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-13T02:43:10.164 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-13T02:43:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-13T02:43:10.551 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-13T02:43:10.581 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-13T02:43:10.614 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 139/198 2024-04-13T02:43:10.675 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 140/198 2024-04-13T02:43:10.721 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-13T02:43:11.758 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-13T02:43:11.798 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-13T02:43:12.554 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 148/198 2024-04-13T02:43:12.626 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 149/198 2024-04-13T02:43:12.760 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-13T02:43:12.790 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-13T02:43:12.890 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-13T02:43:13.060 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 144/198 2024-04-13T02:43:13.092 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-13T02:43:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-13T02:43:13.115 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:13.115 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-13T02:43:13.115 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-13T02:43:13.115 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-13T02:43:13.115 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:13.162 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-13T02:43:13.170 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-13T02:43:13.268 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 147/198 2024-04-13T02:43:13.505 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-13T02:43:13.550 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-13T02:43:13.573 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-13T02:43:13.573 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:13.573 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-13T02:43:13.573 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-13T02:43:13.573 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-13T02:43:13.573 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:13.614 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-13T02:43:13.637 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-13T02:43:13.637 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:13.637 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-13T02:43:13.637 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:13.682 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-13T02:43:13.705 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-13T02:43:13.705 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:13.705 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-13T02:43:13.705 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-13T02:43:13.706 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-13T02:43:13.706 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:14.013 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-13T02:43:14.035 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-13T02:43:14.036 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:14.036 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-13T02:43:14.036 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-13T02:43:14.036 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-13T02:43:14.036 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:14.082 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 155/198 2024-04-13T02:43:14.112 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 156/198 2024-04-13T02:43:14.139 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-13T02:43:14.325 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 158/198 2024-04-13T02:43:14.378 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-13T02:43:14.435 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-13T02:43:14.486 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-13T02:43:14.521 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-13T02:43:14.546 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 163/198 2024-04-13T02:43:14.577 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-13T02:43:14.607 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-13T02:43:14.671 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-13T02:43:14.732 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-13T02:43:14.764 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-13T02:43:15.344 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-13T02:43:15.386 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-13T02:43:15.406 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-13T02:43:16.226 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 170/198 2024-04-13T02:43:16.315 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-13T02:43:16.395 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-13T02:43:16.425 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-13T02:43:16.450 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-13T02:43:16.475 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-13T02:43:16.501 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-13T02:43:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-13T02:43:16.528 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-13T02:43:16.598 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-13T02:43:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-13T02:43:16.628 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-13T02:43:16.721 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-13T02:43:16.747 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-13T02:43:16.781 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-13T02:43:16.806 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-13T02:43:16.831 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-13T02:43:16.866 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-13T02:43:16.904 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-13T02:43:16.935 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-13T02:43:16.960 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-13T02:43:16.985 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-13T02:43:17.011 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-13T02:43:17.036 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-13T02:43:17.043 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-13T02:43:17.043 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-13T02:43:17.239 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-13T02:43:17.239 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-13T02:43:17.322 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-13T02:43:17.346 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-13T02:43:17.378 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-13T02:43:17.408 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-13T02:43:17.433 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-13T02:43:17.499 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-13T02:43:17.817 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 148/198 2024-04-13T02:43:17.884 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 149/198 2024-04-13T02:43:18.774 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-13T02:43:18.800 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-13T02:43:18.822 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-13T02:43:18.822 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:18.822 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-13T02:43:18.822 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-13T02:43:18.822 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-13T02:43:18.822 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:18.867 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-13T02:43:18.889 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-13T02:43:18.889 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:18.889 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-13T02:43:18.889 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:18.935 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-13T02:43:18.957 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-13T02:43:18.957 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:18.957 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-13T02:43:18.957 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-13T02:43:18.957 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-13T02:43:18.957 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:19.269 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-13T02:43:19.291 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-13T02:43:19.291 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-13T02:43:19.291 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-13T02:43:19.291 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-13T02:43:19.291 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-13T02:43:19.291 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:19.343 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 155/198 2024-04-13T02:43:19.373 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 156/198 2024-04-13T02:43:19.400 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-13T02:43:19.581 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 158/198 2024-04-13T02:43:19.640 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-13T02:43:19.693 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-13T02:43:19.748 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-13T02:43:19.791 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-13T02:43:19.815 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 163/198 2024-04-13T02:43:19.856 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-13T02:43:19.885 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-13T02:43:19.944 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-13T02:43:20.007 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-13T02:43:20.043 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-13T02:43:20.673 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-13T02:43:20.716 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-13T02:43:20.735 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-13T02:43:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 170/198 2024-04-13T02:43:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-13T02:43:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-13T02:43:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-13T02:43:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-13T02:43:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-13T02:43:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-13T02:43:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-13T02:43:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-13T02:43:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-13T02:43:21.975 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-13T02:43:21.975 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-13T02:43:22.051 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-13T02:43:22.092 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-13T02:43:22.127 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-13T02:43:22.153 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-13T02:43:22.177 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-13T02:43:22.222 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-13T02:43:22.267 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-13T02:43:22.307 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-13T02:43:22.332 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-13T02:43:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-13T02:43:22.383 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-13T02:43:22.408 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-13T02:43:22.415 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-13T02:43:22.415 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-13T02:43:22.595 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-13T02:43:22.595 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-13T02:43:22.687 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-13T02:43:22.711 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-13T02:43:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-13T02:43:22.771 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-13T02:43:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-13T02:43:22.861 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-13T02:43:23.104 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-13T02:43:23.104 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 1/198 2024-04-13T02:43:23.104 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2/198 2024-04-13T02:43:23.104 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 3/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 4/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 5/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 6/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 7/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 8/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 9/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 13/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 14/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 15/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-13T02:43:23.105 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 17/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 18/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 19/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 20/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 21/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 22/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 23/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 24/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 25/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 26/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 27/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 28/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 29/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 30/198 2024-04-13T02:43:23.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 31/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 32/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 33/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 34/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 35/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 36/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 37/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 38/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 39/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-13T02:43:23.107 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-13T02:43:23.108 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-13T02:43:23.109 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-13T02:43:23.110 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-13T02:43:23.111 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-13T02:43:23.112 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-13T02:43:23.113 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-13T02:43:23.114 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-13T02:43:23.115 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-13T02:43:23.116 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-13T02:43:23.117 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-13T02:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-13T02:43:26.235 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-13T02:43:26.235 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:26.235 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: acl-2.3.1-4.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.236 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2024-04-13T02:43:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.238 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:26.239 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: jq-1.6-16.el9.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-13T02:43:26.240 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.241 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-13T02:43:26.242 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.14-1.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-13T02:43:26.243 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-13T02:43:26.244 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-13T02:43:26.245 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-13T02:43:26.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-13T02:43:26.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-13T02:43:26.248 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-13T02:43:26.249 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-13T02:43:26.249 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-13T02:43:26.249 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-13T02:43:26.249 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:26.249 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-04-13T02:43:26.735 DEBUG:teuthology.parallel:result is None 2024-04-13T02:43:28.348 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-13T02:43:28.348 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 1/198 2024-04-13T02:43:28.348 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2/198 2024-04-13T02:43:28.348 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 3/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 4/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 5/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 6/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 7/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 8/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 9/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 13/198 2024-04-13T02:43:28.349 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 14/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 15/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 17/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 18/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 19/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 20/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 21/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 22/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 23/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 24/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 25/198 2024-04-13T02:43:28.350 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 26/198 2024-04-13T02:43:28.351 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 27/198 2024-04-13T02:43:28.351 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 28/198 2024-04-13T02:43:28.351 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 29/198 2024-04-13T02:43:28.380 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 30/198 2024-04-13T02:43:28.380 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 31/198 2024-04-13T02:43:28.380 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 32/198 2024-04-13T02:43:28.380 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 33/198 2024-04-13T02:43:28.381 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 34/198 2024-04-13T02:43:28.381 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 35/198 2024-04-13T02:43:28.381 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 36/198 2024-04-13T02:43:28.381 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 37/198 2024-04-13T02:43:28.381 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 38/198 2024-04-13T02:43:28.381 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 39/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-13T02:43:28.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-13T02:43:28.383 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-13T02:43:28.383 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-13T02:43:28.384 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-13T02:43:28.385 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-13T02:43:28.386 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-13T02:43:28.386 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-13T02:43:28.386 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-13T02:43:28.386 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-13T02:43:28.386 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-13T02:43:28.386 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-13T02:43:28.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-13T02:43:28.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-13T02:43:28.389 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-13T02:43:28.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-13T02:43:28.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-13T02:43:28.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-13T02:43:28.394 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-13T02:43:28.395 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-13T02:43:28.396 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-13T02:43:31.587 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-13T02:43:31.587 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:31.587 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-04-13T02:43:31.587 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: acl-2.3.1-4.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.588 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2024-04-13T02:43:31.589 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.590 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2024-04-13T02:43:31.591 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: jq-1.6-16.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-13T02:43:31.592 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: lua-5.4.4-4.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-13T02:43:31.593 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.14-1.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-13T02:43:31.594 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-13T02:43:31.595 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-13T02:43:31.596 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-13T02:43:31.597 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-13T02:43:31.598 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-3.el9.x86_64 2024-04-13T02:43:31.599 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:31.600 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-13T02:43:32.128 DEBUG:teuthology.parallel:result is None 2024-04-13T02:43:32.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-13T02:43:32.272 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-13T02:43:32.294 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-2879.g324baf8d.el9 2024-04-13T02:43:32.294 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2879.g324baf8d.el9 2024-04-13T02:43:32.295 INFO:teuthology.task.install:The correct ceph version 19.0.0-2879.g324baf8d is installed. 2024-04-13T02:43:32.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-13T02:43:32.508 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-13T02:43:32.533 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-2879.g324baf8d.el9 2024-04-13T02:43:32.534 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2879.g324baf8d.el9 2024-04-13T02:43:32.534 INFO:teuthology.task.install:The correct ceph version 19.0.0-2879.g324baf8d is installed. 2024-04-13T02:43:32.535 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-13T02:43:32.536 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:32.536 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-13T02:43:32.565 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:32.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-13T02:43:32.607 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-13T02:43:32.607 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:32.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-04-13T02:43:32.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-13T02:43:32.701 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:32.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-04-13T02:43:32.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-13T02:43:32.802 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-13T02:43:32.802 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:32.802 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-13T02:43:32.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-13T02:43:32.897 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:32.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-13T02:43:32.926 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-13T02:43:32.995 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-13T02:43:32.995 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:32.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-04-13T02:43:33.022 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-13T02:43:33.092 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:33.093 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-04-13T02:43:33.125 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-13T02:43:33.194 INFO:teuthology.run_tasks:Running task ceph... 2024-04-13T02:43:33.288 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-13T02:43:33.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-04-13T02:43:33.291 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-04-13T02:43:33.318 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-13T02:43:33.318 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-13T02:43:33.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-13T02:43:33.385 INFO:tasks.ceph:Creating extra log directories... 2024-04-13T02:43:33.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-13T02:43:33.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-13T02:43:33.459 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-13T02:43:33.459 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-13T02:43:33.460 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-13T02:43:33.460 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:33.460 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-13T02:43:33.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-13T02:43:33.619 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-13T02:43:33.646 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:33.646 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-13T02:43:33.662 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-13T02:43:33.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-13T02:43:33.812 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-13T02:43:33.813 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-13T02:43:33.813 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667', 'branch': 'wip-vshankar-testing-20240411.061452', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7653667', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240411.061452'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240411.061452', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7105, 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'sleep_before_teardown': 0, 'subset': '463/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240411.061452', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDE4YhKRzoHEMOzeuc1OkPtp76JiTyhKvGWF3lV3snxdzoIPxA6aQ2CjyRntFh+gxi2kYhBfZevPWQZg1cBQLzo=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAevLdcjM1VWjO0GvH+dV2t5V5YP8Z2aQA0cMcZTIXYfY/68XOtEFSsZeRtZf9ulmVQaQT7ZzPy21OyTZ+yMIk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_backtrace']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-12_03:11:38', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-13T02:43:33.813 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-13T02:43:33.816 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-13T02:43:33.861 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-04-13T02:43:33.873 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-04-13T02:43:33.928 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:33.928 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-04-13T02:43:33.952 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-13T02:43:33.952 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-04-13T02:43:34.008 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-13 02:43:23.221470571 +0000 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-13 02:41:13.474013969 +0000 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-13 02:41:13.474013969 +0000 2024-04-13T02:43:34.009 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-13 02:41:13.474013969 +0000 2024-04-13T02:43:34.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-13T02:43:34.074 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-13T02:43:34.075 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-13T02:43:34.075 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000205976 s, 2.5 MB/s 2024-04-13T02:43:34.076 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-13T02:43:34.132 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-04-13T02:43:34.187 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-13T02:43:34.187 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:34.187 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-13T02:43:34.187 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:34.187 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:34.187 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-13 02:43:23.221470571 +0000 2024-04-13T02:43:34.188 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-13 02:41:13.817006664 +0000 2024-04-13T02:43:34.188 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-13 02:41:13.817006664 +0000 2024-04-13T02:43:34.188 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-13 02:41:13.817006664 +0000 2024-04-13T02:43:34.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-13T02:43:34.253 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-13T02:43:34.254 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-13T02:43:34.254 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000205136 s, 2.5 MB/s 2024-04-13T02:43:34.255 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-13T02:43:34.311 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-13 02:43:23.222470550 +0000 2024-04-13T02:43:34.366 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-13 02:41:14.151999529 +0000 2024-04-13T02:43:34.367 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-13 02:41:14.151999529 +0000 2024-04-13T02:43:34.367 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-13 02:41:14.151999529 +0000 2024-04-13T02:43:34.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-13T02:43:34.431 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-13T02:43:34.431 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-13T02:43:34.431 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000190912 s, 2.7 MB/s 2024-04-13T02:43:34.432 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-13T02:43:34.487 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-04-13 02:43:23.222470550 +0000 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-13 02:41:14.685988154 +0000 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-13 02:41:14.685988154 +0000 2024-04-13T02:43:34.542 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-04-13 02:41:14.685988154 +0000 2024-04-13T02:43:34.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-13T02:43:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-04-13T02:43:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-04-13T02:43:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000180181 s, 2.8 MB/s 2024-04-13T02:43:34.609 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-13T02:43:34.665 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:34.665 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:34.665 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-04-13T02:43:34.682 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-13T02:43:34.682 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-04-13T02:43:34.738 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-13 02:43:17.830732114 +0000 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-13 02:41:15.468373699 +0000 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-13 02:41:15.468373699 +0000 2024-04-13T02:43:34.739 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-13 02:41:15.468373699 +0000 2024-04-13T02:43:34.740 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-13T02:43:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-13T02:43:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-13T02:43:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000271921 s, 1.9 MB/s 2024-04-13T02:43:34.807 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-13T02:43:34.866 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-13 02:43:17.830732114 +0000 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-13 02:41:15.799367615 +0000 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-13 02:41:15.799367615 +0000 2024-04-13T02:43:34.922 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-13 02:41:15.799367615 +0000 2024-04-13T02:43:34.923 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-13T02:43:34.989 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-13T02:43:34.989 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-13T02:43:34.989 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000187462 s, 2.7 MB/s 2024-04-13T02:43:34.990 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-13T02:43:35.047 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-04-13T02:43:35.102 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-13T02:43:35.102 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-13 02:43:17.831732096 +0000 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-13 02:41:16.150361163 +0000 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-13 02:41:16.150361163 +0000 2024-04-13T02:43:35.103 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-13 02:41:16.150361163 +0000 2024-04-13T02:43:35.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-13T02:43:35.168 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-13T02:43:35.168 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-13T02:43:35.168 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000191327 s, 2.7 MB/s 2024-04-13T02:43:35.169 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-13T02:43:35.225 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-13 02:43:17.831732096 +0000 2024-04-13T02:43:35.280 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-13 02:41:16.491354895 +0000 2024-04-13T02:43:35.281 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-13 02:41:16.491354895 +0000 2024-04-13T02:43:35.281 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-13 02:41:16.491354895 +0000 2024-04-13T02:43:35.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-13T02:43:35.345 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-13T02:43:35.345 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-13T02:43:35.345 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000216252 s, 2.4 MB/s 2024-04-13T02:43:35.347 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-13T02:43:35.402 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:35.402 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-13T02:43:35.402 INFO:tasks.ceph:Generating config... 2024-04-13T02:43:35.403 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-13T02:43:35.403 INFO:tasks.ceph:[client] debug client = 20 2024-04-13T02:43:35.403 INFO:tasks.ceph:[client] debug ms = 1 2024-04-13T02:43:35.404 INFO:tasks.ceph:[client] pid file = 2024-04-13T02:43:35.404 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-13T02:43:35.404 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-13T02:43:35.404 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-13T02:43:35.404 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-13T02:43:35.404 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-13T02:43:35.404 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-13T02:43:35.404 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-13T02:43:35.404 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-13T02:43:35.404 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-13T02:43:35.405 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-13T02:43:35.405 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-13T02:43:35.405 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-13T02:43:35.406 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-13T02:43:35.407 INFO:tasks.ceph:Setting up mon.a... 2024-04-13T02:43:35.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-13T02:43:35.458 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2024-04-13T02:43:35.461 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-13T02:43:35.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-13T02:43:35.572 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]')] 2024-04-13T02:43:35.573 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-13T02:43:35.574 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:35.574 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-13T02:43:35.628 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid 202cca92-4b79-424a-b5f1-59b181ba42ec 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = quincy 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:fsid 202cca92-4b79-424a-b5f1-59b181ba42ec 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2024-04-13T02:43:35.712396+0000 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:created 2024-04-13T02:43:35.712396+0000 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 17 (quincy) 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2024-04-13T02:43:35.712 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2024-04-13T02:43:35.713 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-13T02:43:35.713 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-04-13T02:43:35.713 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-13T02:43:35.714 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-13T02:43:35.768 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 202cca92-4b79-424a-b5f1-59b181ba42ec... 2024-04-13T02:43:35.769 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-13T02:43:35.810 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-13T02:43:35.858 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-04-13T02:43:35.858 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-04-13T02:43:35.858 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-13T02:43:35.858 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-04-13T02:43:35.858 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.859 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-04-13T02:43:35.860 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-04-13T02:43:35.861 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 202cca92-4b79-424a-b5f1-59b181ba42ec 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-04-13T02:43:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-04-13T02:43:35.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-04-13T02:43:35.864 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-04-13T02:43:35.865 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-04-13T02:43:35.866 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-04-13T02:43:35.867 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-04-13T02:43:35.868 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-13T02:43:35.869 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: mon down mkfs grace = 300 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-13T02:43:35.870 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-04-13T02:43:35.871 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-04-13T02:43:35.872 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-04-13T02:43:35.873 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-13T02:43:35.874 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-04-13T02:43:35.875 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.114,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on skipped message = False 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 202cca92-4b79-424a-b5f1-59b181ba42ec 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.876 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.877 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-04-13T02:43:35.878 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-04-13T02:43:35.879 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2024-04-13T02:43:35.880 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.881 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: mon down mkfs grace = 300 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: mon op complaint time = 120 2024-04-13T02:43:35.882 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 600 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = "" 2024-04-13T02:43:35.883 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds balancer = 20 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug frag = True 2024-04-13T02:43:35.884 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug scatterstat = True 2024-04-13T02:43:35.885 INFO:teuthology.orchestra.run.smithi130.stdout: mds op complaint time = 180 2024-04-13T02:43:35.885 INFO:teuthology.orchestra.run.smithi130.stdout: mds verify scatter = True 2024-04-13T02:43:35.885 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2024-04-13T02:43:35.885 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2024-04-13T02:43:35.885 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2024-04-13T02:43:35.886 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-13T02:43:35.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-13T02:43:35.981 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-13T02:43:35.982 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:35.982 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-13T02:43:35.997 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:35.997 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-13T02:43:36.052 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:43:36.052 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:36.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-13T02:43:36.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-13T02:43:36.131 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:43:36.131 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:36.186 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:43:36.186 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:36.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-13T02:43:36.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-13T02:43:36.227 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:43:36.227 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:36.282 INFO:tasks.ceph:Setting up mon nodes... 2024-04-13T02:43:36.282 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-13T02:43:36.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-13T02:43:36.336 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-13T02:43:36.339 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-13T02:43:36.407 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-13T02:43:36.409 INFO:tasks.ceph:Setting up mds nodes... 2024-04-13T02:43:36.409 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-13T02:43:36.464 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-13T02:43:36.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-13T02:43:36.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-13T02:43:36.590 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-13T02:43:36.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-13T02:43:36.684 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-13T02:43:36.749 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-13T02:43:36.751 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-13T02:43:36.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-13T02:43:36.880 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-13T02:43:36.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-13T02:43:36.915 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-13T02:43:36.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-13T02:43:36.959 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-13T02:43:36.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-13T02:43:37.058 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-13T02:43:37.073 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-13T02:43:37.116 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-13T02:43:37.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-13T02:43:37.213 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-13T02:43:37.229 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-13T02:43:37.229 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-13T02:43:37.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-13T02:43:37.256 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:37.256 INFO:tasks.ceph:role: osd.0 2024-04-13T02:43:37.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:43:37.257 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:37.331 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:37.839 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-13T02:43:37.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-13T02:43:37.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-13T02:43:37.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-13T02:43:37.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-13T02:43:38.054 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:38.055 INFO:tasks.ceph:role: osd.1 2024-04-13T02:43:38.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:43:38.055 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:38.129 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:38.130 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:38.130 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:38.130 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:38.588 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-13T02:43:38.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-13T02:43:38.590 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-13T02:43:38.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-13T02:43:38.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-13T02:43:38.789 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:38.790 INFO:tasks.ceph:role: osd.2 2024-04-13T02:43:38.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:43:38.790 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:38.864 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:39.354 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-13T02:43:39.354 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-13T02:43:39.355 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-13T02:43:39.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-13T02:43:39.535 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-13T02:43:39.602 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:39.602 INFO:tasks.ceph:role: osd.3 2024-04-13T02:43:39.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:43:39.603 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:39.677 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:39.678 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:39.678 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:39.678 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:40.214 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-04-13T02:43:40.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-04-13T02:43:40.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-13T02:43:40.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-13T02:43:40.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:40.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:40.494+0000 7ffb0b0f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-13T02:43:40.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:40.494+0000 7ffb0b0f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-13T02:43:40.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:40.494+0000 7ffb0b0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-13T02:43:40.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:40.494+0000 7ffb0b0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-13T02:43:40.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:40.494+0000 7ffb0b0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-13T02:43:40.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:40.495+0000 7ffb0b0f9640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-13T02:43:43.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-13T02:43:43.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:43.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:43.474+0000 7ff7ebe11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-13T02:43:43.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:43.474+0000 7ff7ebe11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-13T02:43:43.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:43.475+0000 7ff7ebe11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-13T02:43:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:43.475+0000 7ff7ebe11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-13T02:43:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:43.475+0000 7ff7ebe11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-13T02:43:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:43.475+0000 7ff7ebe11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-13T02:43:46.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-13T02:43:46.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:46.441+0000 7f94ba4d3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-13T02:43:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:46.441+0000 7f94ba4d3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-13T02:43:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:46.441+0000 7f94ba4d3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-13T02:43:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:46.441+0000 7f94ba4d3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-13T02:43:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:46.441+0000 7f94ba4d3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-13T02:43:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:46.441+0000 7f94ba4d3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-13T02:43:49.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-13T02:43:49.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:49.421+0000 7f7818611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-13T02:43:49.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:49.421+0000 7f7818611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-13T02:43:49.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:49.421+0000 7f7818611640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-13T02:43:49.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:49.421+0000 7f7818611640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-13T02:43:49.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:49.421+0000 7f7818611640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-13T02:43:49.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:43:49.422+0000 7f7818611640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-13T02:43:52.280 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-13T02:43:52.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-13T02:43:52.343 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:52.343 INFO:tasks.ceph:role: osd.4 2024-04-13T02:43:52.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:43:52.344 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-13T02:43:52.420 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:52.420 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:52.925 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-13T02:43:52.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-13T02:43:52.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-13T02:43:53.045 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-13T02:43:53.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-13T02:43:53.151 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:53.151 INFO:tasks.ceph:role: osd.5 2024-04-13T02:43:53.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:43:53.151 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-13T02:43:53.227 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:53.227 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:53.227 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:53.227 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:53.228 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:53.228 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:53.228 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:53.228 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:53.228 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:53.228 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:53.670 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-13T02:43:53.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-13T02:43:53.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-13T02:43:53.762 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-13T02:43:53.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-13T02:43:53.860 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:53.860 INFO:tasks.ceph:role: osd.6 2024-04-13T02:43:53.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:43:53.860 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-13T02:43:53.935 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:53.935 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:53.936 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:54.412 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-13T02:43:54.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-13T02:43:54.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-13T02:43:54.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-13T02:43:54.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-13T02:43:54.641 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-13T02:43:54.641 INFO:tasks.ceph:role: osd.7 2024-04-13T02:43:54.641 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:43:54.641 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-13T02:43:54.715 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-13T02:43:54.716 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-13T02:43:55.207 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-13T02:43:55.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-13T02:43:55.209 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-13T02:43:55.359 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-13T02:43:55.393 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:55.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:55.496+0000 7f4f6a79a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-13T02:43:55.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:55.496+0000 7f4f6a79a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-13T02:43:55.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:55.496+0000 7f4f6a79a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-13T02:43:55.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:55.496+0000 7f4f6a79a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-13T02:43:55.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:55.497+0000 7f4f6a79a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-13T02:43:55.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:55.497+0000 7f4f6a79a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-13T02:43:58.352 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-13T02:43:58.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:43:58.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:58.468+0000 7f097020c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-13T02:43:58.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:58.469+0000 7f097020c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-13T02:43:58.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:58.469+0000 7f097020c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-13T02:43:58.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:58.469+0000 7f097020c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-13T02:43:58.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:58.469+0000 7f097020c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-13T02:43:58.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:43:58.469+0000 7f097020c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-13T02:44:01.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-13T02:44:01.350 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:44:01.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:01.443+0000 7fdf8bd06640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-13T02:44:01.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:01.443+0000 7fdf8bd06640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-13T02:44:01.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:01.443+0000 7fdf8bd06640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-13T02:44:01.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:01.443+0000 7fdf8bd06640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-13T02:44:01.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:01.443+0000 7fdf8bd06640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-13T02:44:01.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:01.444+0000 7fdf8bd06640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-13T02:44:03.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:44:03.818 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:44:04.307 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-13T02:44:04.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:44:04.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:04.430+0000 7f280656b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-13T02:44:04.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:04.430+0000 7f280656b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-13T02:44:04.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:04.431+0000 7f280656b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-13T02:44:04.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:04.431+0000 7f280656b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-13T02:44:04.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:04.431+0000 7f280656b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-13T02:44:04.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:04.431+0000 7f280656b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-13T02:44:07.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-13T02:44:07.312 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-13T02:44:07.313 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-13T02:44:07.344 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-13T02:44:07.414 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-13T02:44:07.483 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-13T02:44:07.552 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-13T02:44:07.620 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-13T02:44:07.688 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:07.688 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-13T02:44:07.755 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:07.755 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-13T02:44:07.791 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:07.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-13T02:44:07.857 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:07.857 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-13T02:44:07.927 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:07.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-13T02:44:07.996 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:07.996 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-13T02:44:08.064 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:08.065 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-13T02:44:08.132 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:08.133 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-13T02:44:08.200 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:08.200 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-13T02:44:08.216 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:08.216 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-13T02:44:08.272 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:08.272 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-13T02:44:08.287 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:08.288 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-13T02:44:08.342 INFO:tasks.ceph:Adding keys to all mons... 2024-04-13T02:44:08.342 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-13T02:44:08.344 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-13T02:44:08.385 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8Rlm6AwVFBAAzrnR08OP00PAndJKxPZDEQ== 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8RlmbAC0GxAAMUQQKXce0pYUgpNZdCs3wg== 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8Rlmm+8vIxAATcvDe8paFxOhaXPYRKkPxA== 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBc8RlmtX6JHRAAS/WCg9LZPWrMeq6DxrkXkA== 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBf8Rlmyi9aHBAAuqQALUoBV4Vn75E//nG5yg== 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBi8RlmZBZlGhAAzFY2b2F9pJ3mXjy5HBPbnw== 2024-04-13T02:44:08.386 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBl8Rlmir8vGRAAsVtfAKxDwb9Pm4v9XLGowQ== 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8RlmostLGBAAh1tQ8pjAeHmf4JCv4LsLrQ== 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8Rlm56mqLBAAYrVtGjrlPU7ljd6pUkjloQ== 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8RlmOZ5/NBAAlg4mCQYWFulKOJupSHU71Q== 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBr8RlmrQCqHRAAbPwlvZwfZJ3fQPZCBRKxWg== 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBu8RlmDYoAHBAAHmWw0pdFROhZZ68nvawwOw== 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-04-13T02:44:08.387 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBx8RlmjuJ/GhAAzFHXLvwV4WXN0+uuWBapmg== 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB08Rlmrkq7GRAAB9KPFvte8QP25sEwWiEEdA== 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8RlmJv83ORAAjDE2/qy1zVmJSBcoX42cng== 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZ8Rlm4bGHAxAA9+Rm8O/dxFiYTqY3FRIbrw== 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZ8Rlm2PfyBhAAe3QTSSnQ9m/hip2rf3MDJg== 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2024-04-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBZ8RlmtT3FDBAALuX7YexZj/F78l6wVrN3uw== 2024-04-13T02:44:08.407 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-04-13T02:44:08.407 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8Rlm6AwVFBAAzrnR08OP00PAndJKxPZDEQ== 2024-04-13T02:44:08.407 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8RlmbAC0GxAAMUQQKXce0pYUgpNZdCs3wg== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8Rlmm+8vIxAATcvDe8paFxOhaXPYRKkPxA== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBc8RlmtX6JHRAAS/WCg9LZPWrMeq6DxrkXkA== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBf8Rlmyi9aHBAAuqQALUoBV4Vn75E//nG5yg== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBi8RlmZBZlGhAAzFY2b2F9pJ3mXjy5HBPbnw== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBl8Rlmir8vGRAAsVtfAKxDwb9Pm4v9XLGowQ== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8RlmostLGBAAh1tQ8pjAeHmf4JCv4LsLrQ== 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2024-04-13T02:44:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8Rlm56mqLBAAYrVtGjrlPU7ljd6pUkjloQ== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8RlmOZ5/NBAAlg4mCQYWFulKOJupSHU71Q== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBr8RlmrQCqHRAAbPwlvZwfZJ3fQPZCBRKxWg== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBu8RlmDYoAHBAAHmWw0pdFROhZZ68nvawwOw== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBx8RlmjuJ/GhAAzFHXLvwV4WXN0+uuWBapmg== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQB08Rlmrkq7GRAAB9KPFvte8QP25sEwWiEEdA== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBY8RlmJv83ORAAjDE2/qy1zVmJSBcoX42cng== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[client.2] 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBZ8Rlm4bGHAxAA9+Rm8O/dxFiYTqY3FRIbrw== 2024-04-13T02:44:08.409 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-04-13T02:44:08.410 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBZ8Rlm2PfyBhAAe3QTSSnQ9m/hip2rf3MDJg== 2024-04-13T02:44:08.410 INFO:teuthology.orchestra.run.smithi130.stdout:[client.3] 2024-04-13T02:44:08.410 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBZ8RlmtT3FDBAALuX7YexZj/F78l6wVrN3uw== 2024-04-13T02:44:08.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-13T02:44:08.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-13T02:44:08.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.561 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.725 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.779 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:08.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-13T02:44:08.833 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-13T02:44:08.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.887 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.944 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-13T02:44:08.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.054 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.106 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.161 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.164 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-13T02:44:09.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.218 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.275 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.278 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.332 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.334 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-13T02:44:09.446 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-13T02:44:09.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-13T02:44:09.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-13T02:44:09.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-13T02:44:09.596 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-13T02:44:09.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-13T02:44:09.721 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-13T02:44:09.748 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-13T02:44:09.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-13T02:44:09.912 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-13T02:44:09.938 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:44:09.940 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-13T02:44:09.993 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-13T02:44:09.993 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-13T02:44:09.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-13T02:44:09.995 INFO:tasks.ceph.mon.a:Started 2024-04-13T02:44:09.996 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-13T02:44:09.996 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-13T02:44:10.036 INFO:tasks.ceph.mon.b:Started 2024-04-13T02:44:10.036 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-13T02:44:10.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-13T02:44:10.039 INFO:tasks.ceph.mon.c:Started 2024-04-13T02:44:10.039 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-13T02:44:10.039 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-13T02:44:10.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-13T02:44:10.044 INFO:tasks.ceph.mgr.y:Started 2024-04-13T02:44:10.044 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-13T02:44:10.044 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-13T02:44:10.046 INFO:tasks.ceph.mgr.x:Started 2024-04-13T02:44:10.046 INFO:tasks.ceph:Setting crush tunables to default 2024-04-13T02:44:10.047 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2024-04-13T02:44:10.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.146+0000 7fa757c05640 1 Processor -- start 2024-04-13T02:44:10.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.146+0000 7fa757c05640 1 -- start start 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa757c05640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa757c05640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa757c05640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa757c05640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa75015f0a0 con 0x7fa7500b3720 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa757c05640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa7500ba280 con 0x7fa75015ecc0 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa757c05640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa7500ba4d0 con 0x7fa7500d3270 2024-04-13T02:44:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57514/0 (socket says 172.21.15.114:57514) 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 learned_addr learned my addr 172.21.15.114:0/1149822840 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-13T02:44:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.147+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-13T02:44:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T02:44:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-13T02:44:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.348+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-13T02:44:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-13T02:44:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-13T02:44:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:10.749+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-13T02:44:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7551a0640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7559a1640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-13T02:44:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-13T02:44:11.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:11.550+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-13T02:44:13.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 msgr2=0x7fa7500b95f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-13T02:44:13.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7500d3270 0x7fa7500b95f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:13.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 msgr2=0x7fa7500d2d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-13T02:44:13.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.130:3300/0 conn(0x7fa75015ecc0 0x7fa7500d2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:13.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 -- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 msgr2=0x7fa7500b9b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-13T02:44:13.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 --2- 172.21.15.114:0/1149822840 >> v2:172.21.15.114:3300/0 conn(0x7fa7500b3720 0x7fa7500b9b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:13.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 -- 172.21.15.114:0/1149822840 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7500ba7b0 con 0x7fa73c003690 2024-04-13T02:44:13.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:13.148+0000 7fa7477fe640 1 -- 172.21.15.114:0/1149822840 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa73c00c070 con 0x7fa73c007320 2024-04-13T02:44:15.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.311+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826032343 0 0) 0x7fa7500ba7b0 con 0x7fa73c003690 2024-04-13T02:44:15.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.311+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa734003520 con 0x7fa73c003690 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.311+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069119337 0 0) 0x7fa73c00c070 con 0x7fa73c007320 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.311+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7500ba7b0 con 0x7fa73c007320 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2304587278 0 0) 0x7fa734003520 con 0x7fa73c003690 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 >> v1:172.21.15.130:6789/0 conn(0x7fa73c007320 legacy=0x7fa73c0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c00d310 con 0x7fa73c003690 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fa74c009a00 con 0x7fa73c003690 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 >> v1:172.21.15.114:6789/0 conn(0x7fa73c003690 legacy=0x7fa73c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 reap_dead start 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734003bc0 0x7fa734003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa734004800 0x7fa734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7340099b0 0x7fa73400bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:15.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa73400c310 con 0x7fa7340099b0 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa73400c4c0 con 0x7fa734003bc0 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa73400c6c0 con 0x7fa734004800 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7340099b0 0x7fa73400bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7559a1640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734003bc0 0x7fa734003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa734004800 0x7fa734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa734004800 msgr2=0x7fa734004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa734004800 0x7fa734004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734003bc0 msgr2=0x7fa734003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734003bc0 0x7fa734003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7561a2640 1 -- 172.21.15.114:0/1149822840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa734003520 con 0x7fa7340099b0 2024-04-13T02:44:15.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.312+0000 7fa7551a0640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa734004800 0x7fa734004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:15.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.314+0000 7fa7561a2640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7340099b0 0x7fa73400bda0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c8300 tx=0x7fa734005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69570ce0fec29056 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.314+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748032070 con 0x7fa7340099b0 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.314+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa748036400 con 0x7fa7340099b0 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.314+0000 7fa75499f640 1 -- 172.21.15.114:0/1149822840 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74800f040 con 0x7fa7340099b0 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 -- 172.21.15.114:0/1149822840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7340099b0 msgr2=0x7fa73400bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7340099b0 0x7fa73400bda0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c8300 tx=0x7fa734005830 comp rx=0 tx=0).stop 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 -- 172.21.15.114:0/1149822840 shutdown_connections 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7340099b0 0x7fa73400bda0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa734004800 0x7fa734004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 --2- 172.21.15.114:0/1149822840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734003bc0 0x7fa734003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 -- 172.21.15.114:0/1149822840 >> 172.21.15.114:0/1149822840 conn(0x7fa750073480 msgr2=0x7fa750073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 -- 172.21.15.114:0/1149822840 shutdown_connections 2024-04-13T02:44:15.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.315+0000 7fa757c05640 1 -- 172.21.15.114:0/1149822840 wait complete. 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 Processor -- start 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 -- start start 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 0x7fa7500ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734004800 0x7fa750142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7340099b0 0x7fa750142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa7500b3c70 con 0x7fa734003bc0 2024-04-13T02:44:15.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7500b90d0 con 0x7fa734004800 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.317+0000 7fa757c05640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa7500b3df0 con 0x7fa7340099b0 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 0x7fa7500ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 0x7fa7500ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57610/0 (socket says 172.21.15.114:57610) 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 -- 172.21.15.114:0/4143258146 learned_addr learned my addr 172.21.15.114:0/4143258146 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7561a2640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7340099b0 0x7fa750142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7551a0640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734004800 0x7fa750142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 -- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7340099b0 msgr2=0x7fa750142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7340099b0 0x7fa750142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 -- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734004800 msgr2=0x7fa750142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734004800 0x7fa750142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 -- 172.21.15.114:0/4143258146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa750153350 con 0x7fa734003bc0 2024-04-13T02:44:15.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.318+0000 7fa7559a1640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 0x7fa7500ce060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa74c003fc0 tx=0x7fa74c014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:15.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.320+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c01b030 con 0x7fa734003bc0 2024-04-13T02:44:15.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.321+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74c017440 con 0x7fa734003bc0 2024-04-13T02:44:15.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.321+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7500d45d0 con 0x7fa734003bc0 2024-04-13T02:44:15.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.321+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c017870 con 0x7fa734003bc0 2024-04-13T02:44:15.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.321+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7500d4b90 con 0x7fa734003bc0 2024-04-13T02:44:15.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.322+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa74c01e030 con 0x7fa734003bc0 2024-04-13T02:44:15.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.322+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa74c01f790 con 0x7fa734003bc0 2024-04-13T02:44:15.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.322+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa750068c80 con 0x7fa734003bc0 2024-04-13T02:44:15.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.324+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa74c010070 con 0x7fa734003bc0 2024-04-13T02:44:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.392+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa7500ba430 con 0x7fa734003bc0 2024-04-13T02:44:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.396+0000 7fa7467fc640 1 -- 172.21.15.114:0/4143258146 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa74c01f9e0 con 0x7fa734003bc0 2024-04-13T02:44:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 msgr2=0x7fa7500ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 0x7fa7500ce060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa74c003fc0 tx=0x7fa74c014690 comp rx=0 tx=0).stop 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 shutdown_connections 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa7340099b0 0x7fa750142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa734004800 0x7fa750142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 --2- 172.21.15.114:0/4143258146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa734003bc0 0x7fa7500ce060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 >> 172.21.15.114:0/4143258146 conn(0x7fa750073480 msgr2=0x7fa7501517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 shutdown_connections 2024-04-13T02:44:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:15.397+0000 7fa757c05640 1 -- 172.21.15.114:0/4143258146 wait complete. 2024-04-13T02:44:15.409 INFO:tasks.ceph:check_enable_crimson: False 2024-04-13T02:44:15.409 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-13T02:44:15.409 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:15.409 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-13T02:44:15.437 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:15.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-13T02:44:15.504 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:15.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-13T02:44:15.574 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:15.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-13T02:44:15.641 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:15.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-13T02:44:15.669 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:15.669 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-13T02:44:15.736 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:15.736 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-13T02:44:15.793 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:15.792+0000 7f70d6a43040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-13T02:44:15.795 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:15.794+0000 7fe7f222e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-13T02:44:15.804 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:15.804 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-13T02:44:15.846 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:15.846+0000 7f70d6a43040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-13T02:44:15.850 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:15.850+0000 7fe7f222e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-13T02:44:15.871 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new e715281c-364f-497c-9ee4-bc8cab07ab2d 0 2024-04-13T02:44:16.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.011+0000 7fa8518de640 1 Processor -- start 2024-04-13T02:44:16.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.011+0000 7fa8518de640 1 -- start start 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa8518de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa84c15ffc0 0x7fa84c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa8518de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa8518de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa84c0b28f0 0x7fa84c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa8518de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa84c0b3260 con 0x7fa84c15ffc0 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa8518de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa84c15d620 con 0x7fa84c0b28f0 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa8518de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa84c15d900 con 0x7fa84c15ce30 2024-04-13T02:44:16.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84b7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa84c0b28f0 0x7fa84c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c15dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48598/0 (socket says 172.21.15.130:48598) 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 -- 172.21.15.130:0/1992491500 learned_addr learned my addr 172.21.15.130:0/1992491500 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 -- 172.21.15.130:0/1992491500 >> v2:172.21.15.130:3300/0 conn(0x7fa84c0b28f0 msgr2=0x7fa84c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84affd640 1 --2- 172.21.15.130:0/1992491500 >> v2:172.21.15.114:3300/0 conn(0x7fa84c15ffc0 0x7fa84c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 --2- 172.21.15.130:0/1992491500 >> v2:172.21.15.130:3300/0 conn(0x7fa84c0b28f0 0x7fa84c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 -- 172.21.15.130:0/1992491500 >> v2:172.21.15.114:3300/0 conn(0x7fa84c15ffc0 msgr2=0x7fa84c06c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 --2- 172.21.15.130:0/1992491500 >> v2:172.21.15.114:3300/0 conn(0x7fa84c15ffc0 0x7fa84c06c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84a7fc640 1 -- 172.21.15.130:0/1992491500 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c15dbe0 con 0x7fa84c15ce30 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.012+0000 7fa84affd640 1 --2- 172.21.15.130:0/1992491500 >> v2:172.21.15.114:3300/0 conn(0x7fa84c15ffc0 0x7fa84c06c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.013+0000 7fa84a7fc640 1 --2- 172.21.15.130:0/1992491500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c15dff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa84c15d830 tx=0x7fa83402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2bd46a1c5faeed server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.013+0000 7fa849ffb640 1 -- 172.21.15.130:0/1992491500 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834035020 con 0x7fa84c15ce30 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.013+0000 7fa849ffb640 1 -- 172.21.15.130:0/1992491500 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa834031640 con 0x7fa84c15ce30 2024-04-13T02:44:16.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.013+0000 7fa849ffb640 1 -- 172.21.15.130:0/1992491500 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83402d040 con 0x7fa84c15ce30 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 -- 172.21.15.130:0/1992491500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 msgr2=0x7fa84c15dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 --2- 172.21.15.130:0/1992491500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c15dff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa84c15d830 tx=0x7fa83402b8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 -- 172.21.15.130:0/1992491500 shutdown_connections 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 --2- 172.21.15.130:0/1992491500 >> v2:172.21.15.130:3300/0 conn(0x7fa84c0b28f0 0x7fa84c0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 --2- 172.21.15.130:0/1992491500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c15dff0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 --2- 172.21.15.130:0/1992491500 >> v2:172.21.15.114:3300/0 conn(0x7fa84c15ffc0 0x7fa84c06c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 -- 172.21.15.130:0/1992491500 >> 172.21.15.130:0/1992491500 conn(0x7fa84c0b6ee0 msgr2=0x7fa84c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 -- 172.21.15.130:0/1992491500 shutdown_connections 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.014+0000 7fa8518de640 1 -- 172.21.15.130:0/1992491500 wait complete. 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.015+0000 7fa8518de640 1 Processor -- start 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.015+0000 7fa8518de640 1 -- start start 2024-04-13T02:44:16.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa8518de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 0x7fa84c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa8518de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa8518de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c09eef0 0x7fa84c1f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa8518de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c15e530 con 0x7fa84c09eef0 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa8518de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c15d290 con 0x7fa84c0b28f0 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa8518de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa84c15e6b0 con 0x7fa84c15ce30 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 0x7fa84c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84a7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84a7fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48606/0 (socket says 172.21.15.130:48606) 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 0x7fa84c0ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38794/0 (socket says 172.21.15.130:38794) 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84a7fc640 1 -- 172.21.15.130:0/2780418192 learned_addr learned my addr 172.21.15.130:0/2780418192 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84b7fe640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c09eef0 0x7fa84c1f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 -- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 msgr2=0x7fa84c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 -- 172.21.15.130:0/2780418192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c09eef0 msgr2=0x7fa84c1f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c09eef0 0x7fa84c1f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84affd640 1 -- 172.21.15.130:0/2780418192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c1522a0 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.016+0000 7fa84b7fe640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c09eef0 0x7fa84c1f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa84affd640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 0x7fa84c0ce1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa84400cd80 tx=0x7fa84400a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84400f680 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84400f820 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84400fbf0 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c152580 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c152b40 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa844018400 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.017+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa844022950 con 0x7fa84c0b28f0 2024-04-13T02:44:16.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.018+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84c068c80 con 0x7fa84c0b28f0 2024-04-13T02:44:16.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.020+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa844027080 con 0x7fa84c0b28f0 2024-04-13T02:44:16.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.091+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e715281c-364f-497c-9ee4-bc8cab07ab2d", "id": 0} v 0) -- 0x7fa84c0aeac0 con 0x7fa84c0b28f0 2024-04-13T02:44:16.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.095+0000 7fa843fff640 1 -- 172.21.15.130:0/2780418192 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e715281c-364f-497c-9ee4-bc8cab07ab2d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa844014030 con 0x7fa84c0b28f0 2024-04-13T02:44:16.096 INFO:teuthology.orchestra.run.smithi130.stdout:0 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 msgr2=0x7fa84c0ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 0x7fa84c0ce1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa84400cd80 tx=0x7fa84400a650 comp rx=0 tx=0).stop 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 shutdown_connections 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa84c09eef0 0x7fa84c1f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa84c15ce30 0x7fa84c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 --2- 172.21.15.130:0/2780418192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84c0b28f0 0x7fa84c0ce1a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 >> 172.21.15.130:0/2780418192 conn(0x7fa84c0b6ee0 msgr2=0x7fa84c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 shutdown_connections 2024-04-13T02:44:16.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.096+0000 7fa8518de640 1 -- 172.21.15.130:0/2780418192 wait complete. 2024-04-13T02:44:16.107 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 98224648-a331-467f-bd9a-58835b07bd13 1 2024-04-13T02:44:16.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.206+0000 7f1b2f036640 1 Processor -- start 2024-04-13T02:44:16.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2f036640 1 -- start start 2024-04-13T02:44:16.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2f036640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b281452d0 0x7f1b28147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2f036640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b281483e0 0x7f1b280b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2f036640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280d1a40 con 0x7f1b280b7170 2024-04-13T02:44:16.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2f036640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1b280b75e0 con 0x7f1b281483e0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2f036640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1b280d17f0 con 0x7f1b281452d0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2cdd2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b281452d0 0x7f1b28147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2d5d3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1b280b7170 0x7f1b2806b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33046/0 (socket says 172.21.15.130:33046) 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.207+0000 7f1b2d5d3640 1 -- 172.21.15.130:0/3531113415 learned_addr learned my addr 172.21.15.130:0/3531113415 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b27fff640 1 --2- 172.21.15.130:0/3531113415 >> v2:172.21.15.114:3300/0 conn(0x7f1b281483e0 0x7f1b280b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/3531113415 >> v2:172.21.15.114:3300/0 conn(0x7f1b281483e0 msgr2=0x7f1b280b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b2cdd2640 1 --2- 172.21.15.130:0/3531113415 >> v2:172.21.15.114:3300/0 conn(0x7f1b281483e0 0x7f1b280b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/3531113415 >> v1:172.21.15.130:6789/0 conn(0x7f1b280b7170 legacy=0x7f1b2806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b277fe640 1 -- 172.21.15.130:0/3531113415 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202389835 0 0) 0x7f1b280d1a40 con 0x7f1b280b7170 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/3531113415 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b280d1d20 con 0x7f1b281452d0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.208+0000 7f1b27fff640 1 --2- 172.21.15.130:0/3531113415 >> v2:172.21.15.114:3300/0 conn(0x7f1b281483e0 0x7f1b280b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2cdd2640 1 --2- 172.21.15.130:0/3531113415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b281452d0 0x7f1b28147ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b2806c940 tx=0x7f1b1802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c561ed0a2aaeeab server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b277fe640 1 -- 172.21.15.130:0/3531113415 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b180315a0 con 0x7f1b281452d0 2024-04-13T02:44:16.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b277fe640 1 -- 172.21.15.130:0/3531113415 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b18037070 con 0x7f1b281452d0 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b277fe640 1 -- 172.21.15.130:0/3531113415 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18031960 con 0x7f1b281452d0 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 -- 172.21.15.130:0/3531113415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b281452d0 msgr2=0x7f1b28147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 --2- 172.21.15.130:0/3531113415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b281452d0 0x7f1b28147ea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b2806c940 tx=0x7f1b1802b840 comp rx=0 tx=0).stop 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 -- 172.21.15.130:0/3531113415 shutdown_connections 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 --2- 172.21.15.130:0/3531113415 >> v2:172.21.15.114:3300/0 conn(0x7f1b281483e0 0x7f1b280b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 --2- 172.21.15.130:0/3531113415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b281452d0 0x7f1b28147ea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 -- 172.21.15.130:0/3531113415 >> 172.21.15.130:0/3531113415 conn(0x7f1b2809aa40 msgr2=0x7f1b2809ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 -- 172.21.15.130:0/3531113415 shutdown_connections 2024-04-13T02:44:16.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.209+0000 7f1b2f036640 1 -- 172.21.15.130:0/3531113415 wait complete. 2024-04-13T02:44:16.214 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 Processor -- start 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 -- start start 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 0x7f1b280d0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 0x7f1b281e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b281483e0 0x7f1b280b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280b48d0 con 0x7f1b281483e0 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280d22e0 con 0x7f1b280b7170 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2f036640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280b4a50 con 0x7f1b281452d0 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.211+0000 7f1b2cdd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 0x7f1b280d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 0x7f1b281e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 0x7f1b280d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38814/0 (socket says 172.21.15.130:38814) 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/722887096 learned_addr learned my addr 172.21.15.130:0/722887096 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 0x7f1b281e3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48614/0 (socket says 172.21.15.130:48614) 2024-04-13T02:44:16.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2d5d3640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b281483e0 0x7f1b280b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 msgr2=0x7f1b281e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 0x7f1b281e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/722887096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b281483e0 msgr2=0x7f1b280b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b281483e0 0x7f1b280b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 -- 172.21.15.130:0/722887096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b281e4780 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b27fff640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 0x7f1b281e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2cdd2640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 0x7f1b280d0720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b18034040 tx=0x7f1b180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18004230 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b180043f0 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b281e4a60 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18003850 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b281e5020 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b1804f430 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.212+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1b1802f030 con 0x7f1b280b7170 2024-04-13T02:44:16.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.213+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b28068c80 con 0x7f1b280b7170 2024-04-13T02:44:16.218 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.217+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1b18041070 con 0x7f1b280b7170 2024-04-13T02:44:16.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.290+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "98224648-a331-467f-bd9a-58835b07bd13", "id": 1} v 0) -- 0x7f1b2815eda0 con 0x7f1b280b7170 2024-04-13T02:44:16.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.294+0000 7f1b257fa640 1 -- 172.21.15.130:0/722887096 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98224648-a331-467f-bd9a-58835b07bd13", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1b1804f950 con 0x7f1b280b7170 2024-04-13T02:44:16.294 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-13T02:44:16.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.294+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 msgr2=0x7f1b280d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.294+0000 7f1b2f036640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 0x7f1b280d0720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b18034040 tx=0x7f1b180046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 shutdown_connections 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b281483e0 0x7f1b280b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b281452d0 0x7f1b281e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 --2- 172.21.15.130:0/722887096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b280b7170 0x7f1b280d0720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 >> 172.21.15.130:0/722887096 conn(0x7f1b2809aa40 msgr2=0x7f1b28145990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 shutdown_connections 2024-04-13T02:44:16.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.295+0000 7f1b2f036640 1 -- 172.21.15.130:0/722887096 wait complete. 2024-04-13T02:44:16.306 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new b38bbf8b-12ce-4efe-bef2-1f9064ecf87e 2 2024-04-13T02:44:16.382 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.382+0000 7f70d6a43040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-13T02:44:16.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.406+0000 7f3b9cb5e640 1 Processor -- start 2024-04-13T02:44:16.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b9cb5e640 1 -- start start 2024-04-13T02:44:16.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b9cb5e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3b981653e0 0x7f3b981677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b9cb5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b980cf200 con 0x7f3b980734f0 2024-04-13T02:44:16.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b9cb5e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b980cf4e0 con 0x7f3b980cec20 2024-04-13T02:44:16.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b9cb5e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3b9815df80 con 0x7f3b981653e0 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b96d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3b981653e0 0x7f3b981677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b8ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3b980cec20 0x7f3b980738d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33052/0 (socket says 172.21.15.130:33052) 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.407+0000 7f3b8ffff640 1 -- 172.21.15.130:0/4141694754 learned_addr learned my addr 172.21.15.130:0/4141694754 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.408+0000 7f3b96d9d640 1 -- 172.21.15.130:0/4141694754 >> v1:172.21.15.130:6789/0 conn(0x7f3b980cec20 legacy=0x7f3b980738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.408+0000 7f3b96d9d640 1 -- 172.21.15.130:0/4141694754 >> v1:172.21.15.114:6789/0 conn(0x7f3b980734f0 legacy=0x7f3b9815d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.408+0000 7f3b96d9d640 1 -- 172.21.15.130:0/4141694754 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b980cf7c0 con 0x7f3b981653e0 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.408+0000 7f3b96d9d640 1 --2- 172.21.15.130:0/4141694754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b981653e0 0x7f3b981677d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009d90 tx=0x7f3b9002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363118c4c9deb2d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b95d9b640 1 -- 172.21.15.130:0/4141694754 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90039070 con 0x7f3b981653e0 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b95d9b640 1 -- 172.21.15.130:0/4141694754 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9002cc60 con 0x7f3b981653e0 2024-04-13T02:44:16.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b95d9b640 1 -- 172.21.15.130:0/4141694754 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90034660 con 0x7f3b981653e0 2024-04-13T02:44:16.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/4141694754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b981653e0 msgr2=0x7f3b981677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 --2- 172.21.15.130:0/4141694754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b981653e0 0x7f3b981677d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009d90 tx=0x7f3b9002beb0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/4141694754 shutdown_connections 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 --2- 172.21.15.130:0/4141694754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b981653e0 0x7f3b981677d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/4141694754 >> 172.21.15.130:0/4141694754 conn(0x7f3b98072a00 msgr2=0x7f3b98072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/4141694754 shutdown_connections 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.409+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/4141694754 wait complete. 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 Processor -- start 2024-04-13T02:44:16.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 -- start start 2024-04-13T02:44:16.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 0x7f3b9814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b980cec20 0x7f3b98155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b981653e0 0x7f3b98150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9806ce60 con 0x7f3b981653e0 2024-04-13T02:44:16.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9806b930 con 0x7f3b980734f0 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9cb5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3b9806cfe0 con 0x7f3b980cec20 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 0x7f3b9814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9659c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 0x7f3b9814d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38824/0 (socket says 172.21.15.130:38824) 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b8ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b980cec20 0x7f3b98155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b9659c640 1 -- 172.21.15.130:0/2163004796 learned_addr learned my addr 172.21.15.130:0/2163004796 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.411+0000 7f3b96d9d640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b981653e0 0x7f3b98150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9659c640 1 -- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b980cec20 msgr2=0x7f3b98155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9659c640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b980cec20 0x7f3b98155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9659c640 1 -- 172.21.15.130:0/2163004796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b981653e0 msgr2=0x7f3b98150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9659c640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b981653e0 0x7f3b98150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9659c640 1 -- 172.21.15.130:0/2163004796 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9814d830 con 0x7f3b980734f0 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9659c640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 0x7f3b9814d250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c400 tx=0x7f3b8800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880052d0 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b88005490 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9814db10 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88007260 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9814e0d0 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b88007400 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.412+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3b88011590 con 0x7f3b980734f0 2024-04-13T02:44:16.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.413+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b980afaf0 con 0x7f3b980734f0 2024-04-13T02:44:16.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.415+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3b980afaf0 con 0x7f3b980734f0 2024-04-13T02:44:16.424 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.424+0000 7fe7f222e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-13T02:44:16.437 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.436+0000 7f70d6a43040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-13T02:44:16.480 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.479+0000 7fe7f222e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-13T02:44:16.481 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.480+0000 7f70d6a43040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-13T02:44:16.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.488+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b38bbf8b-12ce-4efe-bef2-1f9064ecf87e", "id": 2} v 0) -- 0x7f3b9815dda0 con 0x7f3b980734f0 2024-04-13T02:44:16.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.493+0000 7f3b8effd640 1 -- 172.21.15.130:0/2163004796 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b38bbf8b-12ce-4efe-bef2-1f9064ecf87e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3b9815dda0 con 0x7f3b980734f0 2024-04-13T02:44:16.493 INFO:teuthology.orchestra.run.smithi130.stdout:2 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 msgr2=0x7f3b9814d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 0x7f3b9814d250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c400 tx=0x7f3b8800c8c0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 shutdown_connections 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b981653e0 0x7f3b98150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b980cec20 0x7f3b98155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 --2- 172.21.15.130:0/2163004796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b980734f0 0x7f3b9814d250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 >> 172.21.15.130:0/2163004796 conn(0x7f3b98072a00 msgr2=0x7f3b9815ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 shutdown_connections 2024-04-13T02:44:16.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.494+0000 7f3b9cb5e640 1 -- 172.21.15.130:0/2163004796 wait complete. 2024-04-13T02:44:16.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 7448c049-42b1-427b-9e16-0cdf568f0988 3 2024-04-13T02:44:16.529 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.528+0000 7fe7f222e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-13T02:44:16.535 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.535+0000 7f70d6a43040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-13T02:44:16.578 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.576+0000 7f70d6a43040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-13T02:44:16.585 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.585+0000 7fe7f222e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-13T02:44:16.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.605+0000 7f1fee51e640 1 Processor -- start 2024-04-13T02:44:16.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.605+0000 7f1fee51e640 1 -- start start 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fee51e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fe80b6c30 0x7f1fe80b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fee51e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80af5c0 0x7f1fe80afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fee51e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8070f00 con 0x7f1fe80701a0 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fee51e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe8071440 con 0x7f1fe80b6c30 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fee51e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe8070cc0 con 0x7f1fe80af5c0 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fecabb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80af5c0 0x7f1fe80afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fe77fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1fe80701a0 0x7f1fe80705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33068/0 (socket says 172.21.15.130:33068) 2024-04-13T02:44:16.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fe77fe640 1 -- 172.21.15.130:0/3122136752 learned_addr learned my addr 172.21.15.130:0/3122136752 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-13T02:44:16.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fe7fff640 1 --2- 172.21.15.130:0/3122136752 >> v2:172.21.15.114:3300/0 conn(0x7f1fe80b6c30 0x7f1fe80b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fecabb640 1 -- 172.21.15.130:0/3122136752 >> v2:172.21.15.114:3300/0 conn(0x7f1fe80b6c30 msgr2=0x7f1fe80b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:16.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fecabb640 1 --2- 172.21.15.130:0/3122136752 >> v2:172.21.15.114:3300/0 conn(0x7f1fe80b6c30 0x7f1fe80b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fecabb640 1 -- 172.21.15.130:0/3122136752 >> v1:172.21.15.130:6789/0 conn(0x7f1fe80701a0 legacy=0x7f1fe80705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fecabb640 1 -- 172.21.15.130:0/3122136752 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe80711a0 con 0x7f1fe80af5c0 2024-04-13T02:44:16.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.606+0000 7f1fe6ffd640 1 -- 172.21.15.130:0/3122136752 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246831439 0 0) 0x7f1fe8070f00 con 0x7f1fe80701a0 2024-04-13T02:44:16.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.607+0000 7f1fecabb640 1 --2- 172.21.15.130:0/3122136752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80af5c0 0x7f1fe80afa50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009d90 tx=0x7f1fe002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d9b9c198fe1193 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.607+0000 7f1fe6ffd640 1 -- 172.21.15.130:0/3122136752 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0039070 con 0x7f1fe80af5c0 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.607+0000 7f1fe6ffd640 1 -- 172.21.15.130:0/3122136752 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe002cc50 con 0x7f1fe80af5c0 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.607+0000 7f1fe6ffd640 1 -- 172.21.15.130:0/3122136752 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0034440 con 0x7f1fe80af5c0 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 -- 172.21.15.130:0/3122136752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80af5c0 msgr2=0x7f1fe80afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 --2- 172.21.15.130:0/3122136752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80af5c0 0x7f1fe80afa50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009d90 tx=0x7f1fe002bea0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 -- 172.21.15.130:0/3122136752 shutdown_connections 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 --2- 172.21.15.130:0/3122136752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80af5c0 0x7f1fe80afa50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 --2- 172.21.15.130:0/3122136752 >> v2:172.21.15.114:3300/0 conn(0x7f1fe80b6c30 0x7f1fe80b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 -- 172.21.15.130:0/3122136752 >> 172.21.15.130:0/3122136752 conn(0x7f1fe809aa40 msgr2=0x7f1fe809ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 -- 172.21.15.130:0/3122136752 shutdown_connections 2024-04-13T02:44:16.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.608+0000 7f1fee51e640 1 -- 172.21.15.130:0/3122136752 wait complete. 2024-04-13T02:44:16.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.609+0000 7f1fee51e640 1 Processor -- start 2024-04-13T02:44:16.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.609+0000 7f1fee51e640 1 -- start start 2024-04-13T02:44:16.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fee51e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 0x7f1fe80d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fee51e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fe80af5c0 0x7f1fe81e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fee51e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 0x7f1fe81e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fee51e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe80af0a0 con 0x7f1fe80af5c0 2024-04-13T02:44:16.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fee51e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe80aedc0 con 0x7f1fe80b6c30 2024-04-13T02:44:16.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fee51e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe81453d0 con 0x7f1fe80701a0 2024-04-13T02:44:16.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 0x7f1fe80d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 0x7f1fe81e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 0x7f1fe81e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38840/0 (socket says 172.21.15.130:38840) 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 -- 172.21.15.130:0/2453880809 learned_addr learned my addr 172.21.15.130:0/2453880809 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 0x7f1fe80d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48642/0 (socket says 172.21.15.130:48642) 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fe77fe640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fe80af5c0 0x7f1fe81e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 -- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 msgr2=0x7f1fe80d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 0x7f1fe80d1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 -- 172.21.15.130:0/2453880809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fe80af5c0 msgr2=0x7f1fe81e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fe80af5c0 0x7f1fe81e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 -- 172.21.15.130:0/2453880809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe81f3020 con 0x7f1fe80b6c30 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fe7fff640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 0x7f1fe80d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.610+0000 7f1fecabb640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 0x7f1fe81e44c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009d90 tx=0x7f1fe0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0044020 con 0x7f1fe80b6c30 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe003a040 con 0x7f1fe80b6c30 2024-04-13T02:44:16.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe81f2260 con 0x7f1fe80b6c30 2024-04-13T02:44:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0039050 con 0x7f1fe80b6c30 2024-04-13T02:44:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe81f2820 con 0x7f1fe80b6c30 2024-04-13T02:44:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1fe0003990 con 0x7f1fe80b6c30 2024-04-13T02:44:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.611+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1fe00047b0 con 0x7f1fe80b6c30 2024-04-13T02:44:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.612+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe8068c80 con 0x7f1fe80b6c30 2024-04-13T02:44:16.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.614+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1fe004e060 con 0x7f1fe80b6c30 2024-04-13T02:44:16.632 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.630+0000 7fe7f222e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-13T02:44:16.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.686+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7448c049-42b1-427b-9e16-0cdf568f0988", "id": 3} v 0) -- 0x7f1fe8075220 con 0x7f1fe80b6c30 2024-04-13T02:44:16.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.692+0000 7f1fe4ff9640 1 -- 172.21.15.130:0/2453880809 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7448c049-42b1-427b-9e16-0cdf568f0988", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1fe0004000 con 0x7f1fe80b6c30 2024-04-13T02:44:16.693 INFO:teuthology.orchestra.run.smithi130.stdout:3 2024-04-13T02:44:16.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.692+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 msgr2=0x7f1fe81e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.692+0000 7f1fee51e640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 0x7f1fe81e44c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009d90 tx=0x7f1fe0004a40 comp rx=0 tx=0).stop 2024-04-13T02:44:16.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 shutdown_connections 2024-04-13T02:44:16.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fe80b6c30 0x7f1fe81e44c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fe80af5c0 0x7f1fe81e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 --2- 172.21.15.130:0/2453880809 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1fe80701a0 0x7f1fe80d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 >> 172.21.15.130:0/2453880809 conn(0x7f1fe809aa40 msgr2=0x7f1fe8141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 shutdown_connections 2024-04-13T02:44:16.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.693+0000 7f1fee51e640 1 -- 172.21.15.130:0/2453880809 wait complete. 2024-04-13T02:44:16.695 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.693+0000 7f70d6a43040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-13T02:44:16.704 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new be7127fd-e876-4384-8b8d-cccb93fa39e6 4 2024-04-13T02:44:16.754 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.753+0000 7fe7f222e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-13T02:44:16.763 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.762+0000 7f70d6a43040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-13T02:44:16.808 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.807+0000 7f70d6a43040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-13T02:44:16.827 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.827+0000 7fe7f222e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-13T02:44:16.846 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.845+0000 7f6ae971e640 1 Processor -- start 2024-04-13T02:44:16.846 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.845+0000 7f6ae971e640 1 -- start start 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae971e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6ae406c040 0x7f6ae40b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae971e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae415f0f0 con 0x7f6ae4148490 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae971e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae40b4d20 con 0x7f6ae40b47a0 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae971e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae415f370 con 0x7f6ae406c040 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae27fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6ae406c040 0x7f6ae40b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae37fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6ae40b47a0 0x7f6ae415fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33084/0 (socket says 172.21.15.130:33084) 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae27fc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6ae406c040 0x7f6ae40b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38854/0 (socket says 172.21.15.130:38854) 2024-04-13T02:44:16.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae37fe640 1 -- 172.21.15.130:0/112404216 learned_addr learned my addr 172.21.15.130:0/112404216 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae27fc640 1 -- 172.21.15.130:0/112404216 >> v1:172.21.15.130:6789/0 conn(0x7f6ae40b47a0 legacy=0x7f6ae415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.846+0000 7f6ae27fc640 1 -- 172.21.15.130:0/112404216 >> v1:172.21.15.114:6789/0 conn(0x7f6ae4148490 legacy=0x7f6ae406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.847+0000 7f6ae27fc640 1 -- 172.21.15.130:0/112404216 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae415f650 con 0x7f6ae406c040 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.847+0000 7f6ae27fc640 1 --2- 172.21.15.130:0/112404216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae40b2dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0097a0 tx=0x7f6acc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22eedafa5319e165 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.847+0000 7f6ae1ffb640 1 -- 172.21.15.130:0/112404216 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc034070 con 0x7f6ae406c040 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.847+0000 7f6ae1ffb640 1 -- 172.21.15.130:0/112404216 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc030610 con 0x7f6ae406c040 2024-04-13T02:44:16.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.847+0000 7f6ae1ffb640 1 -- 172.21.15.130:0/112404216 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0309e0 con 0x7f6ae406c040 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 -- 172.21.15.130:0/112404216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 msgr2=0x7f6ae40b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 --2- 172.21.15.130:0/112404216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae40b2dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0097a0 tx=0x7f6acc02b960 comp rx=0 tx=0).stop 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 -- 172.21.15.130:0/112404216 shutdown_connections 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 --2- 172.21.15.130:0/112404216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae40b2dc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 -- 172.21.15.130:0/112404216 >> 172.21.15.130:0/112404216 conn(0x7f6ae40b6ee0 msgr2=0x7f6ae409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 -- 172.21.15.130:0/112404216 shutdown_connections 2024-04-13T02:44:16.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.848+0000 7f6ae971e640 1 -- 172.21.15.130:0/112404216 wait complete. 2024-04-13T02:44:16.851 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.849+0000 7f6ae971e640 1 Processor -- start 2024-04-13T02:44:16.851 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.849+0000 7f6ae971e640 1 -- start start 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae971e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae41f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae971e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 0x7f6ae41f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae971e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ae4148490 0x7f6ae413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae971e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41606e0 con 0x7f6ae4148490 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae971e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4160560 con 0x7f6ae406c040 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae971e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae4160860 con 0x7f6ae40b47a0 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae27fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 0x7f6ae41f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae27fc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 0x7f6ae41f7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48644/0 (socket says 172.21.15.130:48644) 2024-04-13T02:44:16.853 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae27fc640 1 -- 172.21.15.130:0/576138941 learned_addr learned my addr 172.21.15.130:0/576138941 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae2ffd640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae41f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.850+0000 7f6ae37fe640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ae4148490 0x7f6ae413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae2ffd640 1 -- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 msgr2=0x7f6ae41f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae2ffd640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 0x7f6ae41f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae2ffd640 1 -- 172.21.15.130:0/576138941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ae4148490 msgr2=0x7f6ae413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae2ffd640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ae4148490 0x7f6ae413b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae2ffd640 1 -- 172.21.15.130:0/576138941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae41f80d0 con 0x7f6ae406c040 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae27fc640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 0x7f6ae41f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae2ffd640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae41f4550 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c3c0 tx=0x7f6ad400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40052d0 con 0x7f6ae406c040 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4005490 con 0x7f6ae406c040 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae41f8350 con 0x7f6ae406c040 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4007260 con 0x7f6ae406c040 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41419a0 con 0x7f6ae406c040 2024-04-13T02:44:16.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ad4007400 con 0x7f6ae406c040 2024-04-13T02:44:16.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.851+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6ad4011590 con 0x7f6ae406c040 2024-04-13T02:44:16.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.852+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae4068c80 con 0x7f6ae406c040 2024-04-13T02:44:16.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.854+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ae41f80d0 con 0x7f6ae406c040 2024-04-13T02:44:16.860 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.860+0000 7f70d6a43040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-13T02:44:16.876 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.876+0000 7fe7f222e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-13T02:44:16.907 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:16.906+0000 7f70d6a43040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-13T02:44:16.925 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.925+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be7127fd-e876-4384-8b8d-cccb93fa39e6", "id": 4} v 0) -- 0x7f6ae406f540 con 0x7f6ae406c040 2024-04-13T02:44:16.929 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.928+0000 7fe7f222e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-13T02:44:16.931 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.930+0000 7f6adb7fe640 1 -- 172.21.15.130:0/576138941 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be7127fd-e876-4384-8b8d-cccb93fa39e6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6ae415f0f0 con 0x7f6ae406c040 2024-04-13T02:44:16.931 INFO:teuthology.orchestra.run.smithi130.stdout:4 2024-04-13T02:44:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 msgr2=0x7f6ae41f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae41f4550 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c3c0 tx=0x7f6ad400c880 comp rx=0 tx=0).stop 2024-04-13T02:44:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 shutdown_connections 2024-04-13T02:44:16.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ae4148490 0x7f6ae413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ae40b47a0 0x7f6ae41f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 --2- 172.21.15.130:0/576138941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ae406c040 0x7f6ae41f4550 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:16.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 >> 172.21.15.130:0/576138941 conn(0x7f6ae40b6ee0 msgr2=0x7f6ae406f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:16.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 shutdown_connections 2024-04-13T02:44:16.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:16.931+0000 7f6ae971e640 1 -- 172.21.15.130:0/576138941 wait complete. 2024-04-13T02:44:16.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 003c41bf-63ce-4095-a52c-c328836f0e27 5 2024-04-13T02:44:16.978 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:16.977+0000 7fe7f222e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.077+0000 7f2d6e088640 1 Processor -- start 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.077+0000 7f2d6e088640 1 -- start start 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d6e088640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 0x7f2d68167470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d6e088640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d680b6a20 con 0x7f2d6809ab90 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d6e088640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d680b6fa0 con 0x7f2d680b3a20 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d6e088640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d680cf6f0 con 0x7f2d680d0b90 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d67fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 0x7f2d68167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d66ffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2d680b3a20 0x7f2d6809af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33090/0 (socket says 172.21.15.130:33090) 2024-04-13T02:44:17.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d66ffd640 1 -- 172.21.15.130:0/1107239412 learned_addr learned my addr 172.21.15.130:0/1107239412 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-13T02:44:17.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d67fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 0x7f2d68167470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48650/0 (socket says 172.21.15.130:48650) 2024-04-13T02:44:17.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d67fff640 1 -- 172.21.15.130:0/1107239412 >> v1:172.21.15.130:6789/0 conn(0x7f2d680b3a20 legacy=0x7f2d6809af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d667fc640 1 -- 172.21.15.130:0/1107239412 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432621577 0 0) 0x7f2d680b6fa0 con 0x7f2d680b3a20 2024-04-13T02:44:17.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d67fff640 1 -- 172.21.15.130:0/1107239412 >> v1:172.21.15.114:6789/0 conn(0x7f2d6809ab90 legacy=0x7f2d680b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.078+0000 7f2d67fff640 1 -- 172.21.15.130:0/1107239412 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d680b6cc0 con 0x7f2d680d0b90 2024-04-13T02:44:17.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d67fff640 1 --2- 172.21.15.130:0/1107239412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 0x7f2d68167470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009dc0 tx=0x7f2d6002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d864200ec95c5fca server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d667fc640 1 -- 172.21.15.130:0/1107239412 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60039070 con 0x7f2d680d0b90 2024-04-13T02:44:17.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d667fc640 1 -- 172.21.15.130:0/1107239412 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6002ccd0 con 0x7f2d680d0b90 2024-04-13T02:44:17.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d667fc640 1 -- 172.21.15.130:0/1107239412 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60034660 con 0x7f2d680d0b90 2024-04-13T02:44:17.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d6e088640 1 -- 172.21.15.130:0/1107239412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 msgr2=0x7f2d68167470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d6e088640 1 --2- 172.21.15.130:0/1107239412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 0x7f2d68167470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009dc0 tx=0x7f2d6002bf20 comp rx=0 tx=0).stop 2024-04-13T02:44:17.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d6e088640 1 -- 172.21.15.130:0/1107239412 shutdown_connections 2024-04-13T02:44:17.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d6e088640 1 --2- 172.21.15.130:0/1107239412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d680d0b90 0x7f2d68167470 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.079+0000 7f2d6e088640 1 -- 172.21.15.130:0/1107239412 >> 172.21.15.130:0/1107239412 conn(0x7f2d680b7e40 msgr2=0x7f2d680b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.080+0000 7f2d6e088640 1 -- 172.21.15.130:0/1107239412 shutdown_connections 2024-04-13T02:44:17.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.080+0000 7f2d6e088640 1 -- 172.21.15.130:0/1107239412 wait complete. 2024-04-13T02:44:17.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 Processor -- start 2024-04-13T02:44:17.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 -- start start 2024-04-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 0x7f2d68152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d680b3a20 0x7f2d6815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d680d0b90 0x7f2d680b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6809b800 con 0x7f2d680b3a20 2024-04-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6809b680 con 0x7f2d680d0b90 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.081+0000 7f2d6e088640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6809b980 con 0x7f2d6809ab90 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 0x7f2d68152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 0x7f2d68152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48652/0 (socket says 172.21.15.130:48652) 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d67fff640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d680d0b90 0x7f2d680b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 -- 172.21.15.130:0/2303873350 learned_addr learned my addr 172.21.15.130:0/2303873350 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d66ffd640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d680b3a20 0x7f2d6815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 -- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d680d0b90 msgr2=0x7f2d680b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d680d0b90 0x7f2d680b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 -- 172.21.15.130:0/2303873350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d680b3a20 msgr2=0x7f2d6815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d680b3a20 0x7f2d6815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 -- 172.21.15.130:0/2303873350 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6815b150 con 0x7f2d6809ab90 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d67fff640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d680d0b90 0x7f2d680b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d66ffd640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d680b3a20 0x7f2d6815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d677fe640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 0x7f2d68152ec0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c480 tx=0x7f2d5800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d580052d0 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58005470 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6815b430 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58012870 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.082+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6815b9f0 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.083+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d58012a10 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.083+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f2d58003b70 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.083+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d68068c80 con 0x7f2d6809ab90 2024-04-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.085+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2d58012d00 con 0x7f2d6809ab90 2024-04-13T02:44:17.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.156+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "003c41bf-63ce-4095-a52c-c328836f0e27", "id": 5} v 0) -- 0x7f2d68070630 con 0x7f2d6809ab90 2024-04-13T02:44:17.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.162+0000 7f2d4ffff640 1 -- 172.21.15.130:0/2303873350 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "003c41bf-63ce-4095-a52c-c328836f0e27", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2d580035f0 con 0x7f2d6809ab90 2024-04-13T02:44:17.163 INFO:teuthology.orchestra.run.smithi130.stdout:5 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 msgr2=0x7f2d68152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 0x7f2d68152ec0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c480 tx=0x7f2d5800c940 comp rx=0 tx=0).stop 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 shutdown_connections 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d680d0b90 0x7f2d680b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d680b3a20 0x7f2d6815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 --2- 172.21.15.130:0/2303873350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d6809ab90 0x7f2d68152ec0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 >> 172.21.15.130:0/2303873350 conn(0x7f2d680b7e40 msgr2=0x7f2d6815f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 shutdown_connections 2024-04-13T02:44:17.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.163+0000 7f2d6e088640 1 -- 172.21.15.130:0/2303873350 wait complete. 2024-04-13T02:44:17.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new d5473983-9cb8-4e06-850a-fcd74d360899 6 2024-04-13T02:44:17.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.274+0000 7f57e8b11640 1 Processor -- start 2024-04-13T02:44:17.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.274+0000 7f57e8b11640 1 -- start start 2024-04-13T02:44:17.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e8b11640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 0x7f57e406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e8b11640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e40b7bf0 con 0x7f57e40b7430 2024-04-13T02:44:17.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e8b11640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e40b7910 con 0x7f57e406d770 2024-04-13T02:44:17.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e8b11640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f57e406dbb0 con 0x7f57e415eba0 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 0x7f57e406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 0x7f57e406d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48664/0 (socket says 172.21.15.130:48664) 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e259c640 1 -- 172.21.15.130:0/4113836870 learned_addr learned my addr 172.21.15.130:0/4113836870 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e259c640 1 -- 172.21.15.130:0/4113836870 >> v1:172.21.15.130:6789/0 conn(0x7f57e406d770 legacy=0x7f57e40b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e259c640 1 -- 172.21.15.130:0/4113836870 >> v1:172.21.15.114:6789/0 conn(0x7f57e40b7430 legacy=0x7f57e415fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e1d9b640 1 -- 172.21.15.130:0/4113836870 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410509732 0 0) 0x7f57e40b7910 con 0x7f57e406d770 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.275+0000 7f57e259c640 1 -- 172.21.15.130:0/4113836870 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e415f2d0 con 0x7f57e415eba0 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.276+0000 7f57e259c640 1 --2- 172.21.15.130:0/4113836870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 0x7f57e406d230 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57d40098a0 tx=0x7f57d402ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb29fb2c75d3112 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.276+0000 7f57e1d9b640 1 -- 172.21.15.130:0/4113836870 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d402f830 con 0x7f57e415eba0 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.276+0000 7f57e1d9b640 1 -- 172.21.15.130:0/4113836870 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d402f9d0 con 0x7f57e415eba0 2024-04-13T02:44:17.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.276+0000 7f57e1d9b640 1 -- 172.21.15.130:0/4113836870 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d402fda0 con 0x7f57e415eba0 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 -- 172.21.15.130:0/4113836870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 msgr2=0x7f57e406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 --2- 172.21.15.130:0/4113836870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 0x7f57e406d230 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57d40098a0 tx=0x7f57d402ba10 comp rx=0 tx=0).stop 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 -- 172.21.15.130:0/4113836870 shutdown_connections 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 --2- 172.21.15.130:0/4113836870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e415eba0 0x7f57e406d230 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 -- 172.21.15.130:0/4113836870 >> 172.21.15.130:0/4113836870 conn(0x7f57e40b7e40 msgr2=0x7f57e40b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 -- 172.21.15.130:0/4113836870 shutdown_connections 2024-04-13T02:44:17.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.277+0000 7f57e8b11640 1 -- 172.21.15.130:0/4113836870 wait complete. 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.278+0000 7f57e8b11640 1 Processor -- start 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 -- start start 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 0x7f57e4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57e40b7430 0x7f57e40a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57e415eba0 0x7f57e4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f57e415ef80 con 0x7f57e415eba0 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57e415f890 con 0x7f57e40b7430 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e8b11640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f57e41604c0 con 0x7f57e406d770 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 0x7f57e4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 0x7f57e4154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48678/0 (socket says 172.21.15.130:48678) 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e259c640 1 -- 172.21.15.130:0/1222593467 learned_addr learned my addr 172.21.15.130:0/1222593467 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57dbfff640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57e40b7430 0x7f57e40a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.279+0000 7f57e2d9d640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57e415eba0 0x7f57e4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e259c640 1 -- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57e40b7430 msgr2=0x7f57e40a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e259c640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57e40b7430 0x7f57e40a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e259c640 1 -- 172.21.15.130:0/1222593467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57e415eba0 msgr2=0x7f57e4155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e259c640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57e415eba0 0x7f57e4155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e259c640 1 -- 172.21.15.130:0/1222593467 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e4158ec0 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57dbfff640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57e40b7430 0x7f57e40a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e259c640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 0x7f57e4154cb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f57d4000c00 tx=0x7f57d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4047070 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d402f800 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e409f700 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4042610 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e41567c0 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57d404a070 con 0x7f57e406d770 2024-04-13T02:44:17.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.280+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f57d402d9b0 con 0x7f57e406d770 2024-04-13T02:44:17.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.281+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e4068c80 con 0x7f57e406d770 2024-04-13T02:44:17.285 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.281+0000 7f70d6a43040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-13T02:44:17.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.283+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f57d4033030 con 0x7f57e406d770 2024-04-13T02:44:17.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.357+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5473983-9cb8-4e06-850a-fcd74d360899", "id": 6} v 0) -- 0x7f57e406cdb0 con 0x7f57e406d770 2024-04-13T02:44:17.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.363+0000 7f57daffd640 1 -- 172.21.15.130:0/1222593467 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5473983-9cb8-4e06-850a-fcd74d360899", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f57d402dc90 con 0x7f57e406d770 2024-04-13T02:44:17.364 INFO:teuthology.orchestra.run.smithi130.stdout:6 2024-04-13T02:44:17.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 msgr2=0x7f57e4154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 0x7f57e4154cb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f57d4000c00 tx=0x7f57d4004730 comp rx=0 tx=0).stop 2024-04-13T02:44:17.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 shutdown_connections 2024-04-13T02:44:17.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57e415eba0 0x7f57e4155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57e40b7430 0x7f57e40a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 --2- 172.21.15.130:0/1222593467 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57e406d770 0x7f57e4154cb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 >> 172.21.15.130:0/1222593467 conn(0x7f57e40b7e40 msgr2=0x7f57e409b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 shutdown_connections 2024-04-13T02:44:17.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.364+0000 7f57e8b11640 1 -- 172.21.15.130:0/1222593467 wait complete. 2024-04-13T02:44:17.375 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 4a10c98c-0501-4217-aef9-7461f0b76222 7 2024-04-13T02:44:17.380 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:17.379+0000 7fe7f222e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-13T02:44:17.418 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.417+0000 7f70d6a43040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-13T02:44:17.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 Processor -- start 2024-04-13T02:44:17.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 -- start start 2024-04-13T02:44:17.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 0x7f06ac15db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f06ac0d02a0 0x7f06ac0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ac0d0a40 con 0x7f06ac15d740 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f06ac15e060 con 0x7f06ac0d02a0 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.475+0000 7f06b1db4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f06ac0d0d20 con 0x7f06ac09b230 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06abfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f06ac0d02a0 0x7f06ac0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06aaffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 0x7f06ac15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06aaffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 0x7f06ac15db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48694/0 (socket says 172.21.15.130:48694) 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06abfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f06ac0d02a0 0x7f06ac0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38882/0 (socket says 172.21.15.130:38882) 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06aaffd640 1 -- 172.21.15.130:0/1610861785 learned_addr learned my addr 172.21.15.130:0/1610861785 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06abfff640 1 -- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 msgr2=0x7f06ac15db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06abfff640 1 --2- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 0x7f06ac15db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06abfff640 1 -- 172.21.15.130:0/1610861785 >> v1:172.21.15.114:6789/0 conn(0x7f06ac15d740 legacy=0x7f06ac09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06abfff640 1 -- 172.21.15.130:0/1610861785 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac0d1000 con 0x7f06ac0d02a0 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.476+0000 7f06aaffd640 1 --2- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 0x7f06ac15db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06abfff640 1 --2- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0cd5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9dc7de58e2ca745 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06aa7fc640 1 -- 172.21.15.130:0/1610861785 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4039070 con 0x7f06ac0d02a0 2024-04-13T02:44:17.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06aa7fc640 1 -- 172.21.15.130:0/1610861785 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a402cce0 con 0x7f06ac0d02a0 2024-04-13T02:44:17.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06aa7fc640 1 -- 172.21.15.130:0/1610861785 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4034660 con 0x7f06ac0d02a0 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 -- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 msgr2=0x7f06ac0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 --2- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0cd5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a402bf30 comp rx=0 tx=0).stop 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 -- 172.21.15.130:0/1610861785 shutdown_connections 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 --2- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0cd5c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 --2- 172.21.15.130:0/1610861785 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac09b230 0x7f06ac15db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 -- 172.21.15.130:0/1610861785 >> 172.21.15.130:0/1610861785 conn(0x7f06ac0d26d0 msgr2=0x7f06ac0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.477+0000 7f06b1db4640 1 -- 172.21.15.130:0/1610861785 shutdown_connections 2024-04-13T02:44:17.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.478+0000 7f06b1db4640 1 -- 172.21.15.130:0/1610861785 wait complete. 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.479+0000 7f06b1db4640 1 Processor -- start 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.479+0000 7f06b1db4640 1 -- start start 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.479+0000 7f06b1db4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac09b230 0x7f06ac0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 0x7f06ac0b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac0d15c0 con 0x7f06ac09b230 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac0d0710 con 0x7f06ac0d02a0 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f06ac0cdb00 con 0x7f06ac15d740 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06aaffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 0x7f06ac0b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06aaffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:38890/0 (socket says 172.21.15.130:38890) 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06aaffd640 1 -- 172.21.15.130:0/3195706564 learned_addr learned my addr 172.21.15.130:0/3195706564 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-13T02:44:17.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 0x7f06ac0b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:48704/0 (socket says 172.21.15.130:48704) 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06ab7fe640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac09b230 0x7f06ac0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 -- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 msgr2=0x7f06ac0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 -- 172.21.15.130:0/3195706564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac09b230 msgr2=0x7f06ac0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac09b230 0x7f06ac0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 -- 172.21.15.130:0/3195706564 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac0ca1f0 con 0x7f06ac15d740 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06aaffd640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06ab7fe640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac09b230 0x7f06ac0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06abfff640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 0x7f06ac0b6550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f06a4033000 tx=0x7f06a4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4039050 con 0x7f06ac15d740 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a4045070 con 0x7f06ac15d740 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac0ca4d0 con 0x7f06ac15d740 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4009450 con 0x7f06ac15d740 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.480+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac0caa90 con 0x7f06ac15d740 2024-04-13T02:44:17.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.481+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f06a403e850 con 0x7f06ac15d740 2024-04-13T02:44:17.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.481+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f06a4040450 con 0x7f06ac15d740 2024-04-13T02:44:17.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.481+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac068c80 con 0x7f06ac15d740 2024-04-13T02:44:17.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.484+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f06a404a460 con 0x7f06ac15d740 2024-04-13T02:44:17.521 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:17.521+0000 7fe7f222e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-13T02:44:17.543 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.542+0000 7f70d6a43040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-13T02:44:17.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.556+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4a10c98c-0501-4217-aef9-7461f0b76222", "id": 7} v 0) -- 0x7f06ac09bed0 con 0x7f06ac15d740 2024-04-13T02:44:17.568 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.567+0000 7f0693fff640 1 -- 172.21.15.130:0/3195706564 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a10c98c-0501-4217-aef9-7461f0b76222", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f06a403ec80 con 0x7f06ac15d740 2024-04-13T02:44:17.568 INFO:teuthology.orchestra.run.smithi130.stdout:7 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 msgr2=0x7f06ac0b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 0x7f06ac0b6550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f06a4033000 tx=0x7f06a4004a40 comp rx=0 tx=0).stop 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 shutdown_connections 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06ac15d740 0x7f06ac0b6550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06ac0d02a0 0x7f06ac0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 --2- 172.21.15.130:0/3195706564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac09b230 0x7f06ac0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 >> 172.21.15.130:0/3195706564 conn(0x7f06ac0d26d0 msgr2=0x7f06ac0c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 shutdown_connections 2024-04-13T02:44:17.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:17.568+0000 7f06b1db4640 1 -- 172.21.15.130:0/3195706564 wait complete. 2024-04-13T02:44:17.579 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-13T02:44:17.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-13T02:44:17.582 INFO:tasks.ceph.osd.0:Started 2024-04-13T02:44:17.582 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-13T02:44:17.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-13T02:44:17.586 INFO:tasks.ceph.osd.1:Started 2024-04-13T02:44:17.587 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-13T02:44:17.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-13T02:44:17.589 INFO:tasks.ceph.osd.2:Started 2024-04-13T02:44:17.589 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-13T02:44:17.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-13T02:44:17.591 INFO:tasks.ceph.osd.3:Started 2024-04-13T02:44:17.591 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-13T02:44:17.591 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-13T02:44:17.592 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.591+0000 7f70d6a43040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-13T02:44:17.622 INFO:tasks.ceph.osd.4:Started 2024-04-13T02:44:17.622 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-13T02:44:17.622 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-13T02:44:17.624 INFO:tasks.ceph.osd.5:Started 2024-04-13T02:44:17.624 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-13T02:44:17.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-13T02:44:17.626 INFO:tasks.ceph.osd.6:Started 2024-04-13T02:44:17.626 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-13T02:44:17.626 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-13T02:44:17.628 INFO:tasks.ceph.osd.7:Started 2024-04-13T02:44:17.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:17.635 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:17.635+0000 7fe7f222e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-13T02:44:17.711 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:17.710+0000 7fe7f222e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-13T02:44:17.735 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.734+0000 7f70d6a43040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-13T02:44:17.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.742+0000 7fed3ca76640 1 Processor -- start 2024-04-13T02:44:17.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed3ca76640 1 -- start start 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed3ca76640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed381461f0 0x7fed380ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed3ca76640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed380b3fe0 0x7fed3815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed3ca76640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380b4be0 con 0x7fed380cedf0 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed3ca76640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fed380a9640 con 0x7fed380b3fe0 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed3ca76640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fed380cf250 con 0x7fed381461f0 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed36d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed380b3fe0 0x7fed3815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed2ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fed380cedf0 0x7fed380b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48812/0 (socket says 172.21.15.114:48812) 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.743+0000 7fed2ffff640 1 -- 172.21.15.114:0/1227268205 learned_addr learned my addr 172.21.15.114:0/1227268205 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed3659c640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed381461f0 0x7fed380ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed35d9b640 1 -- 172.21.15.114:0/1227268205 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785506157 0 0) 0x7fed380b4be0 con 0x7fed380cedf0 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed35d9b640 1 -- 172.21.15.114:0/1227268205 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed24003520 con 0x7fed380cedf0 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed36d9d640 1 -- 172.21.15.114:0/1227268205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed381461f0 msgr2=0x7fed380ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed36d9d640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed381461f0 0x7fed380ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed36d9d640 1 -- 172.21.15.114:0/1227268205 >> v1:172.21.15.114:6789/0 conn(0x7fed380cedf0 legacy=0x7fed380b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed36d9d640 1 -- 172.21.15.114:0/1227268205 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed380b4620 con 0x7fed380b3fe0 2024-04-13T02:44:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.744+0000 7fed3659c640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed381461f0 0x7fed380ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.745+0000 7fed36d9d640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815d7b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed30009dc0 tx=0x7fed3002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b1a405ba488cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.745+0000 7fed35d9b640 1 -- 172.21.15.114:0/1227268205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30039070 con 0x7fed380b3fe0 2024-04-13T02:44:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.745+0000 7fed35d9b640 1 -- 172.21.15.114:0/1227268205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3002cc40 con 0x7fed380b3fe0 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.745+0000 7fed35d9b640 1 -- 172.21.15.114:0/1227268205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30034440 con 0x7fed380b3fe0 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 -- 172.21.15.114:0/1227268205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 msgr2=0x7fed3815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815d7b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed30009dc0 tx=0x7fed3002be90 comp rx=0 tx=0).stop 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 -- 172.21.15.114:0/1227268205 shutdown_connections 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815d7b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 --2- 172.21.15.114:0/1227268205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed381461f0 0x7fed380ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 -- 172.21.15.114:0/1227268205 >> 172.21.15.114:0/1227268205 conn(0x7fed380b27b0 msgr2=0x7fed380b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 -- 172.21.15.114:0/1227268205 shutdown_connections 2024-04-13T02:44:17.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.746+0000 7fed3ca76640 1 -- 172.21.15.114:0/1227268205 wait complete. 2024-04-13T02:44:17.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.748+0000 7fed3ca76640 1 Processor -- start 2024-04-13T02:44:17.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.748+0000 7fed3ca76640 1 -- start start 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3ca76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3ca76640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed380cedf0 0x7fed381f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3ca76640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed381461f0 0x7fed381f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3ca76640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fed3815d290 con 0x7fed380b3fe0 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3ca76640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed3815cfb0 con 0x7fed381461f0 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3ca76640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fed381465d0 con 0x7fed380cedf0 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57642/0 (socket says 172.21.15.114:57642) 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 -- 172.21.15.114:0/2511498949 learned_addr learned my addr 172.21.15.114:0/2511498949 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed36d9d640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed381461f0 0x7fed381f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed2ffff640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed380cedf0 0x7fed381f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 -- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed380cedf0 msgr2=0x7fed381f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed380cedf0 0x7fed381f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 -- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed381461f0 msgr2=0x7fed381f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed381461f0 0x7fed381f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.749+0000 7fed3659c640 1 -- 172.21.15.114:0/2511498949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed380c6490 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed3659c640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815c1d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e960 tx=0x7fed2800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28017070 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2800ca00 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed380c6770 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2800cdd0 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed380c6d30 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed2801a070 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.750+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fed28009400 con 0x7fed380b3fe0 2024-04-13T02:44:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.751+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed380704e0 con 0x7fed380b3fe0 2024-04-13T02:44:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.753+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fed380704e0 con 0x7fed380b3fe0 2024-04-13T02:44:17.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.815+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed38068c80 con 0x7fed380b3fe0 2024-04-13T02:44:17.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.815+0000 7fed2effd640 1 -- 172.21.15.114:0/2511498949 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fed28013470 con 0x7fed380b3fe0 2024-04-13T02:44:17.816 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:17.816 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:17.558879+0000","last_up_change":"0.000000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 msgr2=0x7fed3815c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815c1d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed2800e960 tx=0x7fed2800ee20 comp rx=0 tx=0).stop 2024-04-13T02:44:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 shutdown_connections 2024-04-13T02:44:17.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed381461f0 0x7fed381f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed380cedf0 0x7fed381f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 --2- 172.21.15.114:0/2511498949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed380b3fe0 0x7fed3815c1d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 >> 172.21.15.114:0/2511498949 conn(0x7fed380b27b0 msgr2=0x7fed380b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 shutdown_connections 2024-04-13T02:44:17.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:17.816+0000 7fed3ca76640 1 -- 172.21.15.114:0/2511498949 wait complete. 2024-04-13T02:44:17.827 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-13T02:44:17.828 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-13T02:44:17.828 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:17.827+0000 7fe7f222e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-13T02:44:17.837 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.837+0000 7f70d6a43040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-13T02:44:17.921 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:17.921+0000 7fe7f222e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-13T02:44:17.996 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:17.995+0000 7f70d6a43040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-13T02:44:18.037 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:18.037+0000 7f70d6a43040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-13T02:44:18.078 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:18.078+0000 7fe7f222e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-13T02:44:18.121 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:18.120+0000 7fe7f222e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-13T02:44:18.193 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:18.192+0000 7f70d6a43040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-13T02:44:18.203 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-13T02:44:18.202+0000 7f8bf6321640 -1 Falling back to public interface 2024-04-13T02:44:18.203 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-13T02:44:18.203+0000 7fb278dbd640 -1 Falling back to public interface 2024-04-13T02:44:18.204 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-13T02:44:18.203+0000 7facc7d8f640 -1 Falling back to public interface 2024-04-13T02:44:18.212 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-13T02:44:18.211+0000 7f3f5f29d640 -1 Falling back to public interface 2024-04-13T02:44:18.222 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-13T02:44:18.221+0000 7f3a7fbfa640 -1 Falling back to public interface 2024-04-13T02:44:18.222 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-13T02:44:18.221+0000 7f52375fa640 -1 Falling back to public interface 2024-04-13T02:44:18.222 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-13T02:44:18.221+0000 7f52361fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-13T02:44:18.222 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-13T02:44:18.221+0000 7f52361fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-13T02:44:18.227 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-13T02:44:18.226+0000 7f1002dac640 -1 Falling back to public interface 2024-04-13T02:44:18.262 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-13T02:44:18.262+0000 7f50fac10640 -1 Falling back to public interface 2024-04-13T02:44:18.281 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:18.281+0000 7fe7f222e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-13T02:44:18.634 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:18.724 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.723+0000 7f99ecb8c640 1 Processor -- start 2024-04-13T02:44:18.724 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.723+0000 7f99ecb8c640 1 -- start start 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99ecb8c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f99e815c920 0x7f99e806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99ecb8c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99ecb8c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e80b3e30 con 0x7f99e815c540 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99ecb8c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f99e80b4a40 con 0x7f99e815c920 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99ecb8c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f99e80b4110 con 0x7f99e80733b0 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99e5d9b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f99e815c920 0x7f99e806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99e6d9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99e659c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f99e815c540 0x7f99e8070cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56588/0 (socket says 172.21.15.114:56588) 2024-04-13T02:44:18.725 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.724+0000 7f99e659c640 1 -- 172.21.15.114:0/642724986 learned_addr learned my addr 172.21.15.114:0/642724986 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:18.727 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.725+0000 7f99e5d9b640 1 -- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 msgr2=0x7f99e806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:18.727 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.725+0000 7f99e5d9b640 1 --2- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.727 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.725+0000 7f99e5d9b640 1 -- 172.21.15.114:0/642724986 >> v1:172.21.15.130:6789/0 conn(0x7f99e815c540 legacy=0x7f99e8070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:18.727 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.725+0000 7f99e5d9b640 1 -- 172.21.15.114:0/642724986 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e80b43f0 con 0x7f99e815c920 2024-04-13T02:44:18.728 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.725+0000 7f99e6d9d640 1 --2- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:18.728 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.725+0000 7f99e5d9b640 1 --2- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e806c950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99d80097a0 tx=0x7f99d802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d88627113ce5252 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:18.728 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99e559a640 1 -- 172.21.15.114:0/642724986 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8035020 con 0x7f99e815c920 2024-04-13T02:44:18.728 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99e559a640 1 -- 172.21.15.114:0/642724986 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d8031830 con 0x7f99e815c920 2024-04-13T02:44:18.728 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99e559a640 1 -- 172.21.15.114:0/642724986 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8031c00 con 0x7f99e815c920 2024-04-13T02:44:18.728 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 -- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 msgr2=0x7f99e806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e806c950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99d80097a0 tx=0x7f99d802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 -- 172.21.15.114:0/642724986 shutdown_connections 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/642724986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e806c950 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 -- 172.21.15.114:0/642724986 >> 172.21.15.114:0/642724986 conn(0x7f99e80728c0 msgr2=0x7f99e8072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 -- 172.21.15.114:0/642724986 shutdown_connections 2024-04-13T02:44:18.729 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.726+0000 7f99ecb8c640 1 -- 172.21.15.114:0/642724986 wait complete. 2024-04-13T02:44:18.731 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 Processor -- start 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 -- start start 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e8143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 0x7f99e81e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e81e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99e80b5050 con 0x7f99e815c540 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99e80b4ed0 con 0x7f99e815c920 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99ecb8c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f99e80b51d0 con 0x7f99e80733b0 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99e5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 0x7f99e81e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99e5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 0x7f99e81e7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50796/0 (socket says 172.21.15.114:50796) 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99e5d9b640 1 -- 172.21.15.114:0/1182949343 learned_addr learned my addr 172.21.15.114:0/1182949343 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99e659c640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e8143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.728+0000 7f99e6d9d640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e81e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:18.732 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99e5d9b640 1 -- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 msgr2=0x7f99e8143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99e5d9b640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e8143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99e5d9b640 1 -- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 msgr2=0x7f99e81e81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99e5d9b640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e81e81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99e5d9b640 1 -- 172.21.15.114:0/1182949343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e8143d50 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99e5d9b640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 0x7f99e81e7cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f99d8034040 tx=0x7f99d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8040070 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d803a850 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e8152530 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8035040 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e8152af0 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99d8038020 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.729+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f99d8044ae0 con 0x7f99e815c540 2024-04-13T02:44:18.733 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.730+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e809f0f0 con 0x7f99e815c540 2024-04-13T02:44:18.734 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.732+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f99d8063e50 con 0x7f99e815c540 2024-04-13T02:44:18.795 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.794+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99e80b05e0 con 0x7f99e815c540 2024-04-13T02:44:18.796 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.795+0000 7f99d6ffd640 1 -- 172.21.15.114:0/1182949343 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f99d8052020 con 0x7f99e815c540 2024-04-13T02:44:18.796 INFO:teuthology.misc.health.smithi114.stdout: 2024-04-13T02:44:18.796 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:17.558879+0000","last_up_change":"0.000000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:18.797 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 msgr2=0x7f99e81e7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:18.797 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 0x7f99e81e7cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f99d8034040 tx=0x7f99d80046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.797 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 shutdown_connections 2024-04-13T02:44:18.797 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99e815c920 0x7f99e81e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.797 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e815c540 0x7f99e81e7cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.797 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 --2- 172.21.15.114:0/1182949343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99e80733b0 0x7f99e8143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:18.798 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 >> 172.21.15.114:0/1182949343 conn(0x7f99e80728c0 msgr2=0x7f99e80b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:18.798 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 shutdown_connections 2024-04-13T02:44:18.798 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:18.796+0000 7f99ecb8c640 1 -- 172.21.15.114:0/1182949343 wait complete. 2024-04-13T02:44:18.806 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-13T02:44:19.035 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:19.035+0000 7f70d6a43040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-13T02:44:19.109 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:19.108+0000 7fe7f222e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-13T02:44:19.311 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:19.310+0000 7f70d6a43040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-13T02:44:19.363 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:19.363+0000 7f70d6a43040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-13T02:44:19.387 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:19.387+0000 7fe7f222e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-13T02:44:19.438 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:19.438+0000 7fe7f222e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-13T02:44:19.478 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:19.477+0000 7f70d6a43040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-13T02:44:19.557 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-13T02:44:19.557+0000 7fe7f222e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-13T02:44:20.491 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:20.490+0000 7f707749d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-13T02:44:20.491 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-04-13T02:44:20.490+0000 7f707749d640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-13T02:44:21.690 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-13T02:44:21.689+0000 7f8bf6321640 -1 osd.1 0 log_to_monitors true 2024-04-13T02:44:21.723 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-13T02:44:21.722+0000 7fb278dbd640 -1 osd.3 0 log_to_monitors true 2024-04-13T02:44:21.734 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-13T02:44:21.730+0000 7f3a7fbfa640 -1 osd.4 0 log_to_monitors true 2024-04-13T02:44:21.735 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-13T02:44:21.735+0000 7f52375fa640 -1 osd.5 0 log_to_monitors true 2024-04-13T02:44:21.750 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-13T02:44:21.750+0000 7f3f5f29d640 -1 osd.2 0 log_to_monitors true 2024-04-13T02:44:21.753 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-13T02:44:21.752+0000 7facc7d8f640 -1 osd.0 0 log_to_monitors true 2024-04-13T02:44:21.753 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-13T02:44:21.752+0000 7f1002dac640 -1 osd.6 0 log_to_monitors true 2024-04-13T02:44:21.780 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-13T02:44:21.779+0000 7f50fac10640 -1 osd.7 0 log_to_monitors true 2024-04-13T02:44:25.499 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-13T02:44:25.499+0000 7f50f6bf8640 -1 osd.7 0 waiting for initial osdmap 2024-04-13T02:44:25.503 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-13T02:44:25.503+0000 7f52339f8640 -1 osd.5 0 waiting for initial osdmap 2024-04-13T02:44:25.509 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-13T02:44:25.508+0000 7f50ee204640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.510 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-13T02:44:25.510+0000 7f522b080640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.556 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-13T02:44:25.556+0000 7f0fff1f8640 -1 osd.6 0 waiting for initial osdmap 2024-04-13T02:44:25.567 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-13T02:44:25.567+0000 7f3a7bff8640 -1 osd.4 0 waiting for initial osdmap 2024-04-13T02:44:25.571 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-13T02:44:25.571+0000 7facc39f7640 -1 osd.0 0 waiting for initial osdmap 2024-04-13T02:44:25.572 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-13T02:44:25.572+0000 7f0ff6880640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.582 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-13T02:44:25.582+0000 7f3a73680640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.584 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-13T02:44:25.583+0000 7f8bf27f8640 -1 osd.1 0 waiting for initial osdmap 2024-04-13T02:44:25.585 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-04-13T02:44:25.585+0000 7facbb880640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.589 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-13T02:44:25.589+0000 7f3f5aff7640 -1 osd.2 0 waiting for initial osdmap 2024-04-13T02:44:25.590 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-13T02:44:25.590+0000 7fb2749f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-13T02:44:25.601 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-04-13T02:44:25.601+0000 7f8be9e80640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.601 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-04-13T02:44:25.601+0000 7f3f52e28640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.611 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-04-13T02:44:25.611+0000 7fb26c880640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-13T02:44:25.612 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:25.700 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.699+0000 7f6e7de60640 1 Processor -- start 2024-04-13T02:44:25.700 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.699+0000 7f6e7de60640 1 -- start start 2024-04-13T02:44:25.701 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e7de60640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e7815ef00 0x7f6e78163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:25.701 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e7de60640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e78163680 con 0x7f6e780b6b50 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e7de60640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e7806ce30 con 0x7f6e7815eb20 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e7de60640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6e780d3c30 con 0x7f6e7815ef00 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e77fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e7815ef00 0x7f6e78163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e76ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6e780b6b50 0x7f6e78162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35178/0 (socket says 172.21.15.114:35178) 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.700+0000 7f6e76ffd640 1 -- 172.21.15.114:0/1593199881 learned_addr learned my addr 172.21.15.114:0/1593199881 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e77fff640 1 -- 172.21.15.114:0/1593199881 >> v1:172.21.15.130:6789/0 conn(0x7f6e7815eb20 legacy=0x7f6e780b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e77fff640 1 -- 172.21.15.114:0/1593199881 >> v1:172.21.15.114:6789/0 conn(0x7f6e780b6b50 legacy=0x7f6e78162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e767fc640 1 -- 172.21.15.114:0/1593199881 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948531523 0 0) 0x7f6e78163680 con 0x7f6e780b6b50 2024-04-13T02:44:25.702 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e77fff640 1 -- 172.21.15.114:0/1593199881 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7806d110 con 0x7f6e7815ef00 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e77fff640 1 --2- 172.21.15.114:0/1593199881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e7815ef00 0x7f6e78163060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009d90 tx=0x7f6e7002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d933a42d35f42cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e767fc640 1 -- 172.21.15.114:0/1593199881 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70039070 con 0x7f6e7815ef00 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.701+0000 7f6e767fc640 1 -- 172.21.15.114:0/1593199881 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7002cc60 con 0x7f6e7815ef00 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e767fc640 1 -- 172.21.15.114:0/1593199881 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70034660 con 0x7f6e7815ef00 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 -- 172.21.15.114:0/1593199881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e7815ef00 msgr2=0x7f6e78163060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 --2- 172.21.15.114:0/1593199881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e7815ef00 0x7f6e78163060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009d90 tx=0x7f6e7002beb0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 -- 172.21.15.114:0/1593199881 shutdown_connections 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 --2- 172.21.15.114:0/1593199881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e7815ef00 0x7f6e78163060 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 -- 172.21.15.114:0/1593199881 >> 172.21.15.114:0/1593199881 conn(0x7f6e780d1620 msgr2=0x7f6e780d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:25.704 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 -- 172.21.15.114:0/1593199881 shutdown_connections 2024-04-13T02:44:25.705 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.702+0000 7f6e7de60640 1 -- 172.21.15.114:0/1593199881 wait complete. 2024-04-13T02:44:25.705 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.703+0000 7f6e7de60640 1 Processor -- start 2024-04-13T02:44:25.705 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.703+0000 7f6e7de60640 1 -- start start 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e7de60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 0x7f6e78159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e7de60640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e7815eb20 0x7f6e78156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e7de60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815ef00 0x7f6e7815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e7de60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7806dbd0 con 0x7f6e780b6b50 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e7de60640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7806d6d0 con 0x7f6e7815ef00 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e7de60640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7806dd50 con 0x7f6e7815eb20 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 0x7f6e78159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 0x7f6e78159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50920/0 (socket says 172.21.15.114:50920) 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 -- 172.21.15.114:0/2345986417 learned_addr learned my addr 172.21.15.114:0/2345986417 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e77fff640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815ef00 0x7f6e7815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:25.708 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e7815eb20 0x7f6e78156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 -- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e7815eb20 msgr2=0x7f6e78156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e7815eb20 0x7f6e78156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 -- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815ef00 msgr2=0x7f6e7815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.704+0000 7f6e777fe640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815ef00 0x7f6e7815ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e777fe640 1 -- 172.21.15.114:0/2345986417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7815a350 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e7815eb20 0x7f6e78156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e777fe640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 0x7f6e78159e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c410 tx=0x7f6e6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68017070 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e680035f0 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e78159050 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e680039e0 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.705+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e78159610 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.706+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e7806e150 con 0x7f6e780b6b50 2024-04-13T02:44:25.709 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.706+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f6e6801a070 con 0x7f6e780b6b50 2024-04-13T02:44:25.710 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.707+0000 7f6e5ffff640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c860 0x7f6e6406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:25.710 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.707+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c860 0x7f6e6406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:25.710 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.707+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f6e68089fd0 con 0x7f6e780b6b50 2024-04-13T02:44:25.710 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.707+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c860 0x7f6e6406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e780ba3c0 tx=0x7f6e6c007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:25.712 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.711+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e680010c0 con 0x7f6e780b6b50 2024-04-13T02:44:25.890 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.889+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e780d2740 con 0x7f6e780b6b50 2024-04-13T02:44:25.890 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.890+0000 7f6e5ffff640 1 -- 172.21.15.114:0/2345986417 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f6e68058cb0 con 0x7f6e780b6b50 2024-04-13T02:44:25.890 INFO:teuthology.misc.health.smithi114.stdout: 2024-04-13T02:44:25.891 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":12,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:23.494752+0000","last_up_change":"0.000000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c860 msgr2=0x7f6e6406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c860 0x7f6e6406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e780ba3c0 tx=0x7f6e6c007ca0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 msgr2=0x7f6e78159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 0x7f6e78159e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800c410 tx=0x7f6e6800c8d0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 shutdown_connections 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815ef00 0x7f6e7815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c860 0x7f6e6406ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e7815eb20 0x7f6e78156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 --2- 172.21.15.114:0/2345986417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780b6b50 0x7f6e78159e10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:25.893 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 >> 172.21.15.114:0/2345986417 conn(0x7f6e780d1620 msgr2=0x7f6e780b9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:25.894 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 shutdown_connections 2024-04-13T02:44:25.894 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:25.892+0000 7f6e7de60640 1 -- 172.21.15.114:0/2345986417 wait complete. 2024-04-13T02:44:25.902 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-13T02:44:32.710 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:32.809 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.807+0000 7f1c9e2ad640 1 Processor -- start 2024-04-13T02:44:32.809 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.807+0000 7f1c9e2ad640 1 -- start start 2024-04-13T02:44:32.811 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c9e2ad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c98145290 0x7f1c980cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:32.811 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c9e2ad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1c9806fa70 0x7f1c9815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:32.811 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c9e2ad640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c98145670 con 0x7f1c980cff40 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c9e2ad640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1c98073050 con 0x7f1c98145290 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c9e2ad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1c98072290 con 0x7f1c9806fa70 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c98145290 0x7f1c980cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c98145290 0x7f1c980cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60708/0 (socket says 172.21.15.114:60708) 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 -- 172.21.15.114:0/368233791 learned_addr learned my addr 172.21.15.114:0/368233791 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c9c84a640 1 --2- 172.21.15.114:0/368233791 >> v2:172.21.15.130:3300/0 conn(0x7f1c9806fa70 0x7f1c9815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 -- 172.21.15.114:0/368233791 >> v2:172.21.15.130:3300/0 conn(0x7f1c9806fa70 msgr2=0x7f1c9815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 --2- 172.21.15.114:0/368233791 >> v2:172.21.15.130:3300/0 conn(0x7f1c9806fa70 0x7f1c9815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 -- 172.21.15.114:0/368233791 >> v1:172.21.15.130:6789/0 conn(0x7f1c980cff40 legacy=0x7f1c9806f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.808+0000 7f1c97fff640 1 -- 172.21.15.114:0/368233791 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c98072570 con 0x7f1c98145290 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c97fff640 1 --2- 172.21.15.114:0/368233791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c98145290 0x7f1c980cfa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c9815f230 tx=0x7f1c8802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f700575a92ec113 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:32.812 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c96ffd640 1 -- 172.21.15.114:0/368233791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8802e070 con 0x7f1c98145290 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c96ffd640 1 -- 172.21.15.114:0/368233791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c88037070 con 0x7f1c98145290 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c96ffd640 1 -- 172.21.15.114:0/368233791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88031a00 con 0x7f1c98145290 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/368233791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c98145290 msgr2=0x7f1c980cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/368233791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c98145290 0x7f1c980cfa00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c9815f230 tx=0x7f1c8802b880 comp rx=0 tx=0).stop 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/368233791 shutdown_connections 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/368233791 >> v2:172.21.15.130:3300/0 conn(0x7f1c9806fa70 0x7f1c9815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/368233791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c98145290 0x7f1c980cfa00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.809+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/368233791 >> 172.21.15.114:0/368233791 conn(0x7f1c980b25c0 msgr2=0x7f1c980b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.810+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/368233791 shutdown_connections 2024-04-13T02:44:32.813 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.810+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/368233791 wait complete. 2024-04-13T02:44:32.819 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.811+0000 7f1c9e2ad640 1 Processor -- start 2024-04-13T02:44:32.819 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.811+0000 7f1c9e2ad640 1 -- start start 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c9806fa70 0x7f1c9813b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 0x7f1c980c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c98145290 0x7f1c980c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c980b5a40 con 0x7f1c980cff40 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c980d0550 con 0x7f1c9806fa70 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1c980b5bc0 con 0x7f1c98145290 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 0x7f1c980c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 0x7f1c980c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60712/0 (socket says 172.21.15.114:60712) 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 -- 172.21.15.114:0/2152672553 learned_addr learned my addr 172.21.15.114:0/2152672553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:32.820 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c97fff640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c9806fa70 0x7f1c9813b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9c84a640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c98145290 0x7f1c980c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 -- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c98145290 msgr2=0x7f1c980c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c98145290 0x7f1c980c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 -- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c9806fa70 msgr2=0x7f1c9813b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c9806fa70 0x7f1c9813b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 -- 172.21.15.114:0/2152672553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c980cc2d0 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c977fe640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 0x7f1c980c7180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00b3f0 tx=0x7f1c8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c015020 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c011830 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c980c9550 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c011c20 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.812+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c980c9b10 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.814+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c98068f30 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.814+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c8c018020 con 0x7f1c980cff40 2024-04-13T02:44:32.821 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.814+0000 7f1c94ff9640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c8406c8f0 0x7f1c8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:32.822 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.815+0000 7f1c97fff640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c8406c8f0 0x7f1c8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:32.822 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.815+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1c8c08b260 con 0x7f1c980cff40 2024-04-13T02:44:32.822 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.815+0000 7f1c97fff640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c8406c8f0 0x7f1c8406edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c88036000 tx=0x7f1c8803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:32.822 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.819+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c8c01f030 con 0x7f1c980cff40 2024-04-13T02:44:32.997 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.996+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c98073c30 con 0x7f1c980cff40 2024-04-13T02:44:32.998 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.996+0000 7f1c94ff9640 1 -- 172.21.15.114:0/2152672553 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f1c8c059420 con 0x7f1c980cff40 2024-04-13T02:44:32.998 INFO:teuthology.misc.health.smithi114.stdout: 2024-04-13T02:44:32.998 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":16,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:29.517500+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c8406c8f0 msgr2=0x7f1c8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c8406c8f0 0x7f1c8406edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c88036000 tx=0x7f1c8803d040 comp rx=0 tx=0).stop 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 msgr2=0x7f1c980c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 0x7f1c980c7180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00b3f0 tx=0x7f1c8c00b8b0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 shutdown_connections 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c8406c8f0 0x7f1c8406edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c98145290 0x7f1c980c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c980cff40 0x7f1c980c7180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 --2- 172.21.15.114:0/2152672553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c9806fa70 0x7f1c9813b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 >> 172.21.15.114:0/2152672553 conn(0x7f1c980b25c0 msgr2=0x7f1c980c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 shutdown_connections 2024-04-13T02:44:33.001 INFO:teuthology.misc.health.smithi114.stderr:2024-04-13T02:44:32.999+0000 7f1c9e2ad640 1 -- 172.21.15.114:0/2152672553 wait complete. 2024-04-13T02:44:33.010 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-13T02:44:33.010 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-13T02:44:33.011 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-13T02:44:33.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-13T02:44:33.013 INFO:tasks.ceph.mds.a:Started 2024-04-13T02:44:33.013 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-13T02:44:33.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-13T02:44:33.015 INFO:tasks.ceph.mds.c:Started 2024-04-13T02:44:33.015 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-13T02:44:33.015 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-13T02:44:33.018 INFO:tasks.ceph.mds.b:Started 2024-04-13T02:44:33.018 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-13T02:44:33.018 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-13T02:44:33.020 INFO:tasks.ceph.mds.d:Started 2024-04-13T02:44:33.020 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-13T02:44:33.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:33.089 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-04-13T02:44:33.090 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-04-13T02:44:33.103 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-04-13T02:44:33.104 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-04-13T02:44:33.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.124+0000 7f8657ade640 1 Processor -- start 2024-04-13T02:44:33.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.124+0000 7f8657ade640 1 -- start start 2024-04-13T02:44:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f8657ade640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86501621d0 0x7f865006cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f8657ade640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86500b3b20 0x7f865006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f8657ade640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500677c0 con 0x7f865006be70 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f8657ade640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8650067a30 con 0x7f86501621d0 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f8657ade640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f865006edb0 con 0x7f86500b3b20 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f865587a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86501621d0 0x7f865006cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f865587a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86501621d0 0x7f865006cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60746/0 (socket says 172.21.15.114:60746) 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.125+0000 7f865587a640 1 -- 172.21.15.114:0/1614898991 learned_addr learned my addr 172.21.15.114:0/1614898991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.126+0000 7f865587a640 1 -- 172.21.15.114:0/1614898991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86500b3b20 msgr2=0x7f865006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.126+0000 7f865587a640 1 --2- 172.21.15.114:0/1614898991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86500b3b20 0x7f865006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.126+0000 7f865587a640 1 -- 172.21.15.114:0/1614898991 >> v1:172.21.15.130:6789/0 conn(0x7f865006be70 legacy=0x7f865006f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.126+0000 7f865587a640 1 -- 172.21.15.114:0/1614898991 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865006f090 con 0x7f86501621d0 2024-04-13T02:44:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.126+0000 7f865587a640 1 --2- 172.21.15.114:0/1614898991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f865006cc70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8640009870 tx=0x7f864002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f2233daa0a674e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.126+0000 7f8654878640 1 -- 172.21.15.114:0/1614898991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640035020 con 0x7f86501621d0 2024-04-13T02:44:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8654878640 1 -- 172.21.15.114:0/1614898991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8640031640 con 0x7f86501621d0 2024-04-13T02:44:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8654878640 1 -- 172.21.15.114:0/1614898991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864002d040 con 0x7f86501621d0 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 -- 172.21.15.114:0/1614898991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 msgr2=0x7f865006cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 --2- 172.21.15.114:0/1614898991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f865006cc70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8640009870 tx=0x7f864002b8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 -- 172.21.15.114:0/1614898991 shutdown_connections 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 --2- 172.21.15.114:0/1614898991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86500b3b20 0x7f865006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 --2- 172.21.15.114:0/1614898991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f865006cc70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 -- 172.21.15.114:0/1614898991 >> 172.21.15.114:0/1614898991 conn(0x7f86500b6700 msgr2=0x7f86500b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 -- 172.21.15.114:0/1614898991 shutdown_connections 2024-04-13T02:44:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.127+0000 7f8657ade640 1 -- 172.21.15.114:0/1614898991 wait complete. 2024-04-13T02:44:33.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.128+0000 7f8657ade640 1 Processor -- start 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.128+0000 7f8657ade640 1 -- start start 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8657ade640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f865006be70 0x7f86501568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8657ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86500b3b20 0x7f86501526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8657ade640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f86501f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8657ade640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f865006d330 con 0x7f86501621d0 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8657ade640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f865006d1b0 con 0x7f86500b3b20 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8657ade640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f86500afd30 con 0x7f865006be70 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f86501f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f86501f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60760/0 (socket says 172.21.15.114:60760) 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 -- 172.21.15.114:0/1923669516 learned_addr learned my addr 172.21.15.114:0/1923669516 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865587a640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f865006be70 0x7f86501568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f8655079640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86500b3b20 0x7f86501526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 -- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f865006be70 msgr2=0x7f86501568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f865006be70 0x7f86501568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 -- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86500b3b20 msgr2=0x7f86501526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86500b3b20 0x7f86501526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 -- 172.21.15.114:0/1923669516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865009ced0 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.129+0000 7f865607b640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f86501f84b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f864800c7b0 tx=0x7f864800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.130+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648017070 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.130+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8648003b80 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.130+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648005070 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.130+0000 7f8657ade640 1 -- 172.21.15.114:0/1923669516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865009d170 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.130+0000 7f8657ade640 1 -- 172.21.15.114:0/1923669516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865009d730 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.131+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8650068c80 con 0x7f86501621d0 2024-04-13T02:44:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.131+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8648005210 con 0x7f86501621d0 2024-04-13T02:44:33.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.131+0000 7f86467fc640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f863406c8f0 0x7f863406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.132+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f864808aae0 con 0x7f86501621d0 2024-04-13T02:44:33.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.132+0000 7f865587a640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f863406c8f0 0x7f863406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.132+0000 7f865587a640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f863406c8f0 0x7f863406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8640036000 tx=0x7f864003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.136+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8648058ca0 con 0x7f86501621d0 2024-04-13T02:44:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.312+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86500b0060 con 0x7f86501621d0 2024-04-13T02:44:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.313+0000 7f86467fc640 1 -- 172.21.15.114:0/1923669516 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f864805cfa0 con 0x7f86501621d0 2024-04-13T02:44:33.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:33.315 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:29.517500+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f863406c8f0 msgr2=0x7f863406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f863406c8f0 0x7f863406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8640036000 tx=0x7f864003c040 comp rx=0 tx=0).stop 2024-04-13T02:44:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 msgr2=0x7f86501f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f86501f84b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f864800c7b0 tx=0x7f864800cbb0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 shutdown_connections 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86501621d0 0x7f86501f84b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86500b3b20 0x7f86501526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f863406c8f0 0x7f863406edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 --2- 172.21.15.114:0/1923669516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f865006be70 0x7f86501568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 >> 172.21.15.114:0/1923669516 conn(0x7f86500b6700 msgr2=0x7f86500b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 shutdown_connections 2024-04-13T02:44:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.316+0000 7f8633fff640 1 -- 172.21.15.114:0/1923669516 wait complete. 2024-04-13T02:44:33.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:44:33.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:44:33.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.429+0000 7faf5eddc640 1 Processor -- start 2024-04-13T02:44:33.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.429+0000 7faf5eddc640 1 -- start start 2024-04-13T02:44:33.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf5eddc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf5809b230 0x7faf580d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf5eddc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf58071330 con 0x7faf5806e2f0 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf5eddc640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5806cae0 con 0x7faf580ce650 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf5eddc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7faf5809bb40 con 0x7faf5809b230 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf57fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf5809b230 0x7faf580d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf57fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf5809b230 0x7faf580d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60776/0 (socket says 172.21.15.114:60776) 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf5d379640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faf5806e2f0 0x7faf580d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52056/0 (socket says 172.21.15.114:52056) 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf57fff640 1 -- 172.21.15.114:0/155282764 learned_addr learned my addr 172.21.15.114:0/155282764 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf57fff640 1 -- 172.21.15.114:0/155282764 >> v1:172.21.15.130:6789/0 conn(0x7faf580ce650 legacy=0x7faf5809ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf57fff640 1 -- 172.21.15.114:0/155282764 >> v1:172.21.15.114:6789/0 conn(0x7faf5806e2f0 legacy=0x7faf580d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf57fff640 1 -- 172.21.15.114:0/155282764 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5806e9f0 con 0x7faf5809b230 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.430+0000 7faf577fe640 1 -- 172.21.15.114:0/155282764 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448020872 0 0) 0x7faf58071330 con 0x7faf5806e2f0 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.431+0000 7faf57fff640 1 --2- 172.21.15.114:0/155282764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5809b230 0x7faf580d07b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf44009870 tx=0x7faf4402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8984da5ec00bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.431+0000 7faf577fe640 1 -- 172.21.15.114:0/155282764 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4402f840 con 0x7faf5809b230 2024-04-13T02:44:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.431+0000 7faf577fe640 1 -- 172.21.15.114:0/155282764 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4402f9e0 con 0x7faf5809b230 2024-04-13T02:44:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.431+0000 7faf577fe640 1 -- 172.21.15.114:0/155282764 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4402fdb0 con 0x7faf5809b230 2024-04-13T02:44:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.431+0000 7faf5eddc640 1 -- 172.21.15.114:0/155282764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5809b230 msgr2=0x7faf580d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.432+0000 7faf5eddc640 1 --2- 172.21.15.114:0/155282764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5809b230 0x7faf580d07b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf44009870 tx=0x7faf4402ba20 comp rx=0 tx=0).stop 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.432+0000 7faf5eddc640 1 -- 172.21.15.114:0/155282764 shutdown_connections 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.432+0000 7faf5eddc640 1 --2- 172.21.15.114:0/155282764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5809b230 0x7faf580d07b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.432+0000 7faf5eddc640 1 -- 172.21.15.114:0/155282764 >> 172.21.15.114:0/155282764 conn(0x7faf580d2720 msgr2=0x7faf580d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.432+0000 7faf5eddc640 1 -- 172.21.15.114:0/155282764 shutdown_connections 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.432+0000 7faf5eddc640 1 -- 172.21.15.114:0/155282764 wait complete. 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.433+0000 7faf5eddc640 1 Processor -- start 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.433+0000 7faf5eddc640 1 -- start start 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 0x7faf5814d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf5809b230 0x7faf580c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf580ce650 0x7faf5814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf5809bd90 con 0x7faf5806e2f0 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf5806ce50 con 0x7faf580ce650 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faf580cea30 con 0x7faf5809b230 2024-04-13T02:44:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 0x7faf5814d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 0x7faf5814d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60792/0 (socket says 172.21.15.114:60792) 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 -- 172.21.15.114:0/2411854797 learned_addr learned my addr 172.21.15.114:0/2411854797 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5d379640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf580ce650 0x7faf5814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 -- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf5809b230 msgr2=0x7faf580c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf5809b230 0x7faf580c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 -- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf580ce650 msgr2=0x7faf5814fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf580ce650 0x7faf5814fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 -- 172.21.15.114:0/2411854797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf580c9d30 con 0x7faf5806e2f0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5d379640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf580ce650 0x7faf5814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5cb78640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 0x7faf5814d720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00c400 tx=0x7faf4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c017070 con 0x7faf5806e2f0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0052d0 con 0x7faf5806e2f0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf580cc940 con 0x7faf5806e2f0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c003830 con 0x7faf5806e2f0 2024-04-13T02:44:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.434+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf580b7330 con 0x7faf5806e2f0 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.435+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf58068c80 con 0x7faf5806e2f0 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.436+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf4c01a070 con 0x7faf5806e2f0 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.436+0000 7faf557fa640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faf3c06c8f0 0x7faf3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.436+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7faf4c08ab20 con 0x7faf5806e2f0 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.436+0000 7faf57fff640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faf3c06c8f0 0x7faf3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.436+0000 7faf57fff640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faf3c06c8f0 0x7faf3c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf44036000 tx=0x7faf44039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.442+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf4c059330 con 0x7faf5806e2f0 2024-04-13T02:44:33.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.615+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf5815ec30 con 0x7faf5806e2f0 2024-04-13T02:44:33.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.615+0000 7faf557fa640 1 -- 172.21.15.114:0/2411854797 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7faf4c058c30 con 0x7faf5806e2f0 2024-04-13T02:44:33.617 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faf3c06c8f0 msgr2=0x7faf3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faf3c06c8f0 0x7faf3c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf44036000 tx=0x7faf44039040 comp rx=0 tx=0).stop 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 msgr2=0x7faf5814d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 0x7faf5814d720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00c400 tx=0x7faf4c00c8c0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 shutdown_connections 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf580ce650 0x7faf5814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faf3c06c8f0 0x7faf3c06edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf5809b230 0x7faf580c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 --2- 172.21.15.114:0/2411854797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5806e2f0 0x7faf5814d720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 >> 172.21.15.114:0/2411854797 conn(0x7faf580d2720 msgr2=0x7faf580ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 shutdown_connections 2024-04-13T02:44:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.617+0000 7faf5eddc640 1 -- 172.21.15.114:0/2411854797 wait complete. 2024-04-13T02:44:33.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:44:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.728+0000 7f6f9380f640 1 Processor -- start 2024-04-13T02:44:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.728+0000 7f6f9380f640 1 -- start start 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f9380f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0d3e20 0x7f6f8c0d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f9380f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6f8c0cf8c0 0x7f6f8c0b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f9380f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c0d4740 con 0x7f6f8c15ee00 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f9380f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8c0d2b10 con 0x7f6f8c0cf8c0 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f9380f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8c0d33b0 con 0x7f6f8c0d3e20 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f90daa640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6f8c15ee00 0x7f6f8c0cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52072/0 (socket says 172.21.15.114:52072) 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f90daa640 1 -- 172.21.15.114:0/3266294100 learned_addr learned my addr 172.21.15.114:0/3266294100 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f915ab640 1 --2- 172.21.15.114:0/3266294100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0d3e20 0x7f6f8c0d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f91dac640 1 --2- 172.21.15.114:0/3266294100 >> v2:172.21.15.130:3300/0 conn(0x7f6f8c0cf8c0 0x7f6f8c0b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f83fff640 1 -- 172.21.15.114:0/3266294100 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353412694 0 0) 0x7f6f8c0d4740 con 0x7f6f8c15ee00 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.729+0000 7f6f83fff640 1 -- 172.21.15.114:0/3266294100 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f78003520 con 0x7f6f8c15ee00 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f915ab640 1 -- 172.21.15.114:0/3266294100 >> v2:172.21.15.130:3300/0 conn(0x7f6f8c0cf8c0 msgr2=0x7f6f8c0b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f915ab640 1 --2- 172.21.15.114:0/3266294100 >> v2:172.21.15.130:3300/0 conn(0x7f6f8c0cf8c0 0x7f6f8c0b79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f83fff640 1 -- 172.21.15.114:0/3266294100 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 829169216 0 0) 0x7f6f78003520 con 0x7f6f8c15ee00 2024-04-13T02:44:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f915ab640 1 -- 172.21.15.114:0/3266294100 >> v1:172.21.15.114:6789/0 conn(0x7f6f8c15ee00 legacy=0x7f6f8c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f915ab640 1 -- 172.21.15.114:0/3266294100 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c0cfdc0 con 0x7f6f8c0d3e20 2024-04-13T02:44:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f91dac640 1 --2- 172.21.15.114:0/3266294100 >> v2:172.21.15.130:3300/0 conn(0x7f6f8c0cf8c0 0x7f6f8c0b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.730+0000 7f6f915ab640 1 --2- 172.21.15.114:0/3266294100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0d3e20 0x7f6f8c0d4200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f880097a0 tx=0x7f6f8802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecba365fb7aa5b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f83fff640 1 -- 172.21.15.114:0/3266294100 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88038070 con 0x7f6f8c0d3e20 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f83fff640 1 -- 172.21.15.114:0/3266294100 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f88031500 con 0x7f6f8c0d3e20 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f83fff640 1 -- 172.21.15.114:0/3266294100 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c001670 con 0x7f6f8c0d3e20 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 -- 172.21.15.114:0/3266294100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0d3e20 msgr2=0x7f6f8c0d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 --2- 172.21.15.114:0/3266294100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0d3e20 0x7f6f8c0d4200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f880097a0 tx=0x7f6f8802b820 comp rx=0 tx=0).stop 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 -- 172.21.15.114:0/3266294100 shutdown_connections 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 --2- 172.21.15.114:0/3266294100 >> v2:172.21.15.130:3300/0 conn(0x7f6f8c0cf8c0 0x7f6f8c0b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 --2- 172.21.15.114:0/3266294100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0d3e20 0x7f6f8c0d4200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 -- 172.21.15.114:0/3266294100 >> 172.21.15.114:0/3266294100 conn(0x7f6f8c06d470 msgr2=0x7f6f8c06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 -- 172.21.15.114:0/3266294100 shutdown_connections 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.731+0000 7f6f9380f640 1 -- 172.21.15.114:0/3266294100 wait complete. 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.732+0000 7f6f9380f640 1 Processor -- start 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.732+0000 7f6f9380f640 1 -- start start 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f9380f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0cf8c0 0x7f6f8c0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f9380f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f8c0d3e20 0x7f6f8c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f9380f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 0x7f6f8c0b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f9380f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c0d3840 con 0x7f6f8c15ee00 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f9380f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c0d3040 con 0x7f6f8c0d3e20 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f9380f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8c0d39c0 con 0x7f6f8c0cf8c0 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 0x7f6f8c0b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 0x7f6f8c0b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60808/0 (socket says 172.21.15.114:60808) 2024-04-13T02:44:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 -- 172.21.15.114:0/1079277039 learned_addr learned my addr 172.21.15.114:0/1079277039 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f90daa640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f8c0d3e20 0x7f6f8c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f915ab640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0cf8c0 0x7f6f8c0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 -- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0cf8c0 msgr2=0x7f6f8c0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0cf8c0 0x7f6f8c0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 -- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f8c0d3e20 msgr2=0x7f6f8c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f8c0d3e20 0x7f6f8c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.733+0000 7f6f91dac640 1 -- 172.21.15.114:0/1079277039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c0c9f30 con 0x7f6f8c15ee00 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.734+0000 7f6f91dac640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 0x7f6f8c0b8cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009e10 tx=0x7f6f8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.734+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84018020 con 0x7f6f8c15ee00 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.734+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84014480 con 0x7f6f8c15ee00 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.734+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c0ca210 con 0x7f6f8c15ee00 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.734+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84014850 con 0x7f6f8c15ee00 2024-04-13T02:44:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.734+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c0ca7d0 con 0x7f6f8c15ee00 2024-04-13T02:44:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.735+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8c068c80 con 0x7f6f8c15ee00 2024-04-13T02:44:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.735+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f84005d10 con 0x7f6f8c15ee00 2024-04-13T02:44:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.736+0000 7f6f81ffb640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6f7006c8f0 0x7f6f7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.736+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6f8408c3f0 con 0x7f6f8c15ee00 2024-04-13T02:44:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.736+0000 7f6f915ab640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6f7006c8f0 0x7f6f7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:33.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.736+0000 7f6f915ab640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6f7006c8f0 0x7f6f7006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f88035000 tx=0x7f6f88008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.740+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f84022030 con 0x7f6f8c15ee00 2024-04-13T02:44:33.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:44:33.882 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:44:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.954+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8c161f30 con 0x7f6f8c15ee00 2024-04-13T02:44:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.955+0000 7f6f81ffb640 1 -- 172.21.15.114:0/1079277039 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f6f84010040 con 0x7f6f8c15ee00 2024-04-13T02:44:33.957 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:33.957 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-13T02:44:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6f7006c8f0 msgr2=0x7f6f7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6f7006c8f0 0x7f6f7006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f88035000 tx=0x7f6f88008030 comp rx=0 tx=0).stop 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 msgr2=0x7f6f8c0b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 0x7f6f8c0b8cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009e10 tx=0x7f6f8400c490 comp rx=0 tx=0).stop 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 shutdown_connections 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f8c15ee00 0x7f6f8c0b8cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f8c0d3e20 0x7f6f8c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6f7006c8f0 0x7f6f7006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 --2- 172.21.15.114:0/1079277039 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f8c0cf8c0 0x7f6f8c0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 >> 172.21.15.114:0/1079277039 conn(0x7f6f8c06d470 msgr2=0x7f6f8c160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 shutdown_connections 2024-04-13T02:44:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:33.958+0000 7f6f9380f640 1 -- 172.21.15.114:0/1079277039 wait complete. 2024-04-13T02:44:35.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:44:36.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.080+0000 7f3279ade640 1 Processor -- start 2024-04-13T02:44:36.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.081+0000 7f3279ade640 1 -- start start 2024-04-13T02:44:36.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.081+0000 7f3279ade640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f327409b1e0 0x7f327409b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.081+0000 7f3279ade640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740c95e0 con 0x7f32740cedf0 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.081+0000 7f3279ade640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740d0320 con 0x7f327409ae00 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.081+0000 7f3279ade640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3274160520 con 0x7f327409b1e0 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3273fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f327409b1e0 0x7f327409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3273fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f327409b1e0 0x7f327409b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60816/0 (socket says 172.21.15.114:60816) 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3273fff640 1 -- 172.21.15.114:0/2108216310 learned_addr learned my addr 172.21.15.114:0/2108216310 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f326affd640 1 --1- 172.21.15.114:0/2108216310 >> v1:172.21.15.114:6789/0 conn(0x7f32740cedf0 0x7f32740cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52078/0 (socket says 172.21.15.114:52078) 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3273fff640 1 -- 172.21.15.114:0/2108216310 >> v1:172.21.15.130:6789/0 conn(0x7f327409ae00 legacy=0x7f32740cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3273fff640 1 -- 172.21.15.114:0/2108216310 >> v1:172.21.15.114:6789/0 conn(0x7f32740cedf0 legacy=0x7f32740cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3273fff640 1 -- 172.21.15.114:0/2108216310 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740d05e0 con 0x7f327409b1e0 2024-04-13T02:44:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.082+0000 7f3272ffd640 1 -- 172.21.15.114:0/2108216310 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248016480 0 0) 0x7f32740c95e0 con 0x7f32740cedf0 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3273fff640 1 --2- 172.21.15.114:0/2108216310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f327409b970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f326c009e50 tx=0x7f326c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a829d332832c9dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3272ffd640 1 -- 172.21.15.114:0/2108216310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c02cb20 con 0x7f327409b1e0 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3272ffd640 1 -- 172.21.15.114:0/2108216310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326c02ccc0 con 0x7f327409b1e0 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3272ffd640 1 -- 172.21.15.114:0/2108216310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c034610 con 0x7f327409b1e0 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 -- 172.21.15.114:0/2108216310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 msgr2=0x7f327409b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 --2- 172.21.15.114:0/2108216310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f327409b970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f326c009e50 tx=0x7f326c02bf80 comp rx=0 tx=0).stop 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 -- 172.21.15.114:0/2108216310 shutdown_connections 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 --2- 172.21.15.114:0/2108216310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f327409b970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 -- 172.21.15.114:0/2108216310 >> 172.21.15.114:0/2108216310 conn(0x7f32740d2750 msgr2=0x7f32740d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 -- 172.21.15.114:0/2108216310 shutdown_connections 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.083+0000 7f3279ade640 1 -- 172.21.15.114:0/2108216310 wait complete. 2024-04-13T02:44:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.084+0000 7f3279ade640 1 Processor -- start 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 -- start start 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f327409ae00 0x7f327406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f32741555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32740cedf0 0x7f327406e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3274160f70 con 0x7f327409b1e0 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3274160770 con 0x7f327409ae00 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.085+0000 7f3279ade640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f32741610f0 con 0x7f32740cedf0 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f32741555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f32741555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60818/0 (socket says 172.21.15.114:60818) 2024-04-13T02:44:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 -- 172.21.15.114:0/4048300447 learned_addr learned my addr 172.21.15.114:0/4048300447 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f32737fe640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f327409ae00 0x7f327406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 -- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32740cedf0 msgr2=0x7f327406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32740cedf0 0x7f327406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 -- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f327409ae00 msgr2=0x7f327406d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f327409ae00 0x7f327406d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 -- 172.21.15.114:0/4048300447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327406ea40 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f326affd640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f32741555a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c390 tx=0x7f325c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c0074e0 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c0047e0 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327406daf0 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c004bd0 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.086+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32740ca510 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.087+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3274068c80 con 0x7f327409b1e0 2024-04-13T02:44:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.087+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f325c011070 con 0x7f327409b1e0 2024-04-13T02:44:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.088+0000 7f3270ff9640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f325406c8f0 0x7f325406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.088+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f325c08b340 con 0x7f327409b1e0 2024-04-13T02:44:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.088+0000 7f32737fe640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f325406c8f0 0x7f325406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.088+0000 7f32737fe640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f325406c8f0 0x7f325406edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32740b1b10 tx=0x7f3264009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.092+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f325c059b50 con 0x7f327409b1e0 2024-04-13T02:44:36.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.306+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3274072430 con 0x7f327409b1e0 2024-04-13T02:44:36.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.306+0000 7f3270ff9640 1 -- 172.21.15.114:0/4048300447 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3876 (secure 0 0 0) 0x7f325c059450 con 0x7f327409b1e0 2024-04-13T02:44:36.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:36.308 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-13T02:44:36.308 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2024-04-13T02:44:36.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f325406c8f0 msgr2=0x7f325406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f325406c8f0 0x7f325406edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32740b1b10 tx=0x7f3264009040 comp rx=0 tx=0).stop 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 msgr2=0x7f32741555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f32741555a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c390 tx=0x7f325c00c850 comp rx=0 tx=0).stop 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 shutdown_connections 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f325406c8f0 0x7f325406edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32740cedf0 0x7f327406e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f327409b1e0 0x7f32741555a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 --2- 172.21.15.114:0/4048300447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f327409ae00 0x7f327406d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 >> 172.21.15.114:0/4048300447 conn(0x7f32740d2750 msgr2=0x7f32740d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.308+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 shutdown_connections 2024-04-13T02:44:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.309+0000 7f3279ade640 1 -- 172.21.15.114:0/4048300447 wait complete. 2024-04-13T02:44:36.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:36.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.419+0000 7fece9bed640 1 Processor -- start 2024-04-13T02:44:36.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.419+0000 7fece9bed640 1 -- start start 2024-04-13T02:44:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.420+0000 7fece9bed640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 0x7fece409b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.420+0000 7fece9bed640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece40c95e0 con 0x7fece409b1e0 2024-04-13T02:44:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.420+0000 7fece9bed640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece40d0320 con 0x7fece40cedf0 2024-04-13T02:44:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.420+0000 7fece9bed640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fece4160520 con 0x7fece409ae00 2024-04-13T02:44:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.420+0000 7fece3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fece409b1e0 0x7fece40cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52088/0 (socket says 172.21.15.114:52088) 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.420+0000 7fece3fff640 1 -- 172.21.15.114:0/3648296874 learned_addr learned my addr 172.21.15.114:0/3648296874 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 0x7fece409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917470121 0 0) 0x7fece40c95e0 con 0x7fece409b1e0 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feccc003520 con 0x7fece409b1e0 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 178890572 0 0) 0x7feccc003520 con 0x7fece409b1e0 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 msgr2=0x7fece409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 0x7fece409b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 >> v1:172.21.15.130:6789/0 conn(0x7fece40cedf0 legacy=0x7fece40cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece40d05e0 con 0x7fece409b1e0 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fecdc0019f0 con 0x7fece409b1e0 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 >> v1:172.21.15.114:6789/0 conn(0x7fece409b1e0 legacy=0x7fece40cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0039e0 0x7feccc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 0x7feccc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feccc004d40 0x7feccc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fece4160520 con 0x7feccc0039e0 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feccc00bb50 con 0x7feccc004d40 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7feccc00bd20 con 0x7fece409ae00 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0039e0 0x7feccc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece2ffd640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 0x7feccc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece3fff640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feccc004d40 0x7feccc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 -- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 msgr2=0x7feccc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fece409ae00 0x7feccc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 -- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feccc004d40 msgr2=0x7feccc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feccc004d40 0x7feccc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.421+0000 7fece37fe640 1 -- 172.21.15.114:0/3648296874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc003520 con 0x7feccc0039e0 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.422+0000 7fece37fe640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0039e0 0x7feccc003dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009af0 tx=0x7feccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c81c329a490b80 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.422+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4039070 con 0x7feccc0039e0 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.422+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd402c6b0 con 0x7feccc0039e0 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.422+0000 7fece27fc640 1 -- 172.21.15.114:0/3648296874 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4009690 con 0x7feccc0039e0 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece9bed640 1 -- 172.21.15.114:0/3648296874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0039e0 msgr2=0x7feccc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece9bed640 1 --2- 172.21.15.114:0/3648296874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0039e0 0x7feccc003dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009af0 tx=0x7feccc005830 comp rx=0 tx=0).stop 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece3fff640 1 -- 172.21.15.114:0/3648296874 reap_dead start 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece9bed640 1 -- 172.21.15.114:0/3648296874 shutdown_connections 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece9bed640 1 -- 172.21.15.114:0/3648296874 >> 172.21.15.114:0/3648296874 conn(0x7fece40d2750 msgr2=0x7fece40d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece9bed640 1 -- 172.21.15.114:0/3648296874 shutdown_connections 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.423+0000 7fece9bed640 1 -- 172.21.15.114:0/3648296874 wait complete. 2024-04-13T02:44:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.424+0000 7fece9bed640 1 Processor -- start 2024-04-13T02:44:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.424+0000 7fece9bed640 1 -- start start 2024-04-13T02:44:36.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feccc0039e0 0x7fece4158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fece40c81b0 0x7fece415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 0x7fece40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fece409b970 con 0x7fece40b6d90 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fece4160770 con 0x7fece40c81b0 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fece409baf0 con 0x7feccc0039e0 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 0x7fece40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 0x7fece40b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60844/0 (socket says 172.21.15.114:60844) 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 -- 172.21.15.114:0/3549071691 learned_addr learned my addr 172.21.15.114:0/3549071691 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece2ffd640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fece40c81b0 0x7fece415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece37fe640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feccc0039e0 0x7fece4158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 -- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feccc0039e0 msgr2=0x7fece4158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feccc0039e0 0x7fece4158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 -- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fece40c81b0 msgr2=0x7fece415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fece40c81b0 0x7fece415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 -- 172.21.15.114:0/3549071691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece40b5cf0 con 0x7fece40b6d90 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece3fff640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 0x7fece40b0630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fece4074130 tx=0x7fecdc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00eaa0 con 0x7fece40b6d90 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecdc00ec60 con 0x7fece40b6d90 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece40b5fd0 con 0x7fece40b6d90 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc014430 con 0x7fece40b6d90 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.425+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece40b6590 con 0x7fece40b6d90 2024-04-13T02:44:36.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.426+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece4160c90 con 0x7fece40b6d90 2024-04-13T02:44:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.427+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecdc0145d0 con 0x7fece40b6d90 2024-04-13T02:44:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.427+0000 7feccbfff640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fecd006c8f0 0x7fecd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.427+0000 7fece37fe640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fecd006c8f0 0x7fecd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.427+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fecdc08b470 con 0x7fece40b6d90 2024-04-13T02:44:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.428+0000 7fece37fe640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fecd006c8f0 0x7fecd006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecd4036000 tx=0x7fecd4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.432+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fece4160c90 con 0x7fece40b6d90 2024-04-13T02:44:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.611+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fece4068c80 con 0x7fece40b6d90 2024-04-13T02:44:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.612+0000 7feccbfff640 1 -- 172.21.15.114:0/3549071691 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7fecdc0595a0 con 0x7fece40b6d90 2024-04-13T02:44:36.613 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:36.613 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:29.517500+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fecd006c8f0 msgr2=0x7fecd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fecd006c8f0 0x7fecd006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecd4036000 tx=0x7fecd4030000 comp rx=0 tx=0).stop 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 msgr2=0x7fece40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 0x7fece40b0630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fece4074130 tx=0x7fecdc007bc0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 shutdown_connections 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40b6d90 0x7fece40b0630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fece40c81b0 0x7fece415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fecd006c8f0 0x7fecd006edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 --2- 172.21.15.114:0/3549071691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feccc0039e0 0x7fece4158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 >> 172.21.15.114:0/3549071691 conn(0x7fece40d2750 msgr2=0x7fece415ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 shutdown_connections 2024-04-13T02:44:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.614+0000 7fece9bed640 1 -- 172.21.15.114:0/3549071691 wait complete. 2024-04-13T02:44:36.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:44:36.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:44:36.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.727+0000 7f3a9f7aa640 1 Processor -- start 2024-04-13T02:44:36.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.727+0000 7f3a9f7aa640 1 -- start start 2024-04-13T02:44:36.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9f7aa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a98145170 0x7f3a980cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9f7aa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a980ce070 0x7f3a980b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9f7aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980b59f0 0x7f3a9806f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9f7aa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3a98145550 con 0x7f3a980ce070 2024-04-13T02:44:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9f7aa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3a980b4410 con 0x7f3a98145170 2024-04-13T02:44:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9f7aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a980b46f0 con 0x7f3a980b59f0 2024-04-13T02:44:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a980ce070 0x7f3a980b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a980ce070 0x7f3a980b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60852/0 (socket says 172.21.15.114:60852) 2024-04-13T02:44:36.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 -- 172.21.15.114:0/242392125 learned_addr learned my addr 172.21.15.114:0/242392125 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 -- 172.21.15.114:0/242392125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980b59f0 msgr2=0x7f3a9806f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9d546640 1 --2- 172.21.15.114:0/242392125 >> v2:172.21.15.130:3300/0 conn(0x7f3a98145170 0x7f3a980cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9dd47640 1 --2- 172.21.15.114:0/242392125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980b59f0 0x7f3a9806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 --2- 172.21.15.114:0/242392125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980b59f0 0x7f3a9806f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 -- 172.21.15.114:0/242392125 >> v2:172.21.15.130:3300/0 conn(0x7f3a98145170 msgr2=0x7f3a980cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 --2- 172.21.15.114:0/242392125 >> v2:172.21.15.130:3300/0 conn(0x7f3a98145170 0x7f3a980cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.728+0000 7f3a9cd45640 1 -- 172.21.15.114:0/242392125 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a980b49d0 con 0x7f3a980ce070 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.729+0000 7f3a9cd45640 1 --2- 172.21.15.114:0/242392125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980ce070 0x7f3a980b54b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a980b4900 tx=0x7f3a8802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217ca8a3f8550f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.729+0000 7f3a8ffff640 1 -- 172.21.15.114:0/242392125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88035020 con 0x7f3a980ce070 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.729+0000 7f3a8ffff640 1 -- 172.21.15.114:0/242392125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88031640 con 0x7f3a980ce070 2024-04-13T02:44:36.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.729+0000 7f3a8ffff640 1 -- 172.21.15.114:0/242392125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8802d040 con 0x7f3a980ce070 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/242392125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980ce070 msgr2=0x7f3a980b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/242392125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980ce070 0x7f3a980b54b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a980b4900 tx=0x7f3a8802b8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/242392125 shutdown_connections 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/242392125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980b59f0 0x7f3a9806f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/242392125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980ce070 0x7f3a980b54b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/242392125 >> v2:172.21.15.130:3300/0 conn(0x7f3a98145170 0x7f3a980cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/242392125 >> 172.21.15.114:0/242392125 conn(0x7f3a980b2460 msgr2=0x7f3a980b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/242392125 shutdown_connections 2024-04-13T02:44:36.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.730+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/242392125 wait complete. 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.731+0000 7f3a9f7aa640 1 Processor -- start 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.731+0000 7f3a9f7aa640 1 -- start start 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 0x7f3a98140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980ce070 0x7f3a981e4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a98145170 0x7f3a9806e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980b4030 con 0x7f3a980b59f0 2024-04-13T02:44:36.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980b4f90 con 0x7f3a98145170 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a980b41b0 con 0x7f3a980ce070 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 0x7f3a98140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 0x7f3a98140020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60858/0 (socket says 172.21.15.114:60858) 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 -- 172.21.15.114:0/2570437274 learned_addr learned my addr 172.21.15.114:0/2570437274 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9cd45640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980ce070 0x7f3a981e4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9dd47640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a98145170 0x7f3a9806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 -- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980ce070 msgr2=0x7f3a981e4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980ce070 0x7f3a981e4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 -- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a98145170 msgr2=0x7f3a9806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a98145170 0x7f3a9806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 -- 172.21.15.114:0/2570437274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9813ef80 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9d546640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 0x7f3a98140020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400cd00 tx=0x7f3a9400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94003990 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94003b30 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9813f260 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.732+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94004020 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.733+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9813f820 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.734+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a98069540 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.734+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a940041c0 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.734+0000 7f3a8dffb640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a7c06c8f0 0x7f3a7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.735+0000 7f3a9cd45640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a7c06c8f0 0x7f3a7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.735+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3a9408bc10 con 0x7f3a980b59f0 2024-04-13T02:44:36.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.735+0000 7f3a9cd45640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a7c06c8f0 0x7f3a7c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a88036000 tx=0x7f3a8803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:36.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.739+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a98069540 con 0x7f3a980b59f0 2024-04-13T02:44:36.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.914+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a98068c80 con 0x7f3a980b59f0 2024-04-13T02:44:36.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.914+0000 7f3a8dffb640 1 -- 172.21.15.114:0/2570437274 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3a94014030 con 0x7f3a980b59f0 2024-04-13T02:44:36.916 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:44:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a7c06c8f0 msgr2=0x7f3a7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a7c06c8f0 0x7f3a7c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a88036000 tx=0x7f3a8803c040 comp rx=0 tx=0).stop 2024-04-13T02:44:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 msgr2=0x7f3a98140020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 0x7f3a98140020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400cd00 tx=0x7f3a9400a5c0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 shutdown_connections 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a98145170 0x7f3a9806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a7c06c8f0 0x7f3a7c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a980ce070 0x7f3a981e4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 --2- 172.21.15.114:0/2570437274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980b59f0 0x7f3a98140020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 >> 172.21.15.114:0/2570437274 conn(0x7f3a980b2460 msgr2=0x7f3a980b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 shutdown_connections 2024-04-13T02:44:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:36.916+0000 7f3a9f7aa640 1 -- 172.21.15.114:0/2570437274 wait complete. 2024-04-13T02:44:36.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-13T02:44:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.030+0000 7f952fec8640 1 Processor -- start 2024-04-13T02:44:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.030+0000 7f952fec8640 1 -- start start 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952fec8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f952806d510 0x7f952809b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952fec8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95280d20d0 0x7f95280ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952fec8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95280d1030 con 0x7f952806d8f0 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952fec8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f952809be50 con 0x7f952806d510 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952fec8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f95280d1310 con 0x7f95280d20d0 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f952806d510 0x7f952809b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f952806d510 0x7f952809b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60862/0 (socket says 172.21.15.114:60862) 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 -- 172.21.15.114:0/1763117284 learned_addr learned my addr 172.21.15.114:0/1763117284 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952e465640 1 --2- 172.21.15.114:0/1763117284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95280d20d0 0x7f95280ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 -- 172.21.15.114:0/1763117284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95280d20d0 msgr2=0x7f95280ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 --2- 172.21.15.114:0/1763117284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95280d20d0 0x7f95280ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 -- 172.21.15.114:0/1763117284 >> v1:172.21.15.130:6789/0 conn(0x7f952806d8f0 legacy=0x7f95280d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.031+0000 7f952dc64640 1 -- 172.21.15.114:0/1763117284 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95280d15f0 con 0x7f952806d510 2024-04-13T02:44:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.032+0000 7f952dc64640 1 --2- 172.21.15.114:0/1763117284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f952806d510 0x7f952809b910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9524009870 tx=0x7f952402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec4f5554e85e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.032+0000 7f952cc62640 1 -- 172.21.15.114:0/1763117284 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524034070 con 0x7f952806d510 2024-04-13T02:44:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.032+0000 7f952cc62640 1 -- 172.21.15.114:0/1763117284 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9524030840 con 0x7f952806d510 2024-04-13T02:44:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.032+0000 7f952cc62640 1 -- 172.21.15.114:0/1763117284 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524030c10 con 0x7f952806d510 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 -- 172.21.15.114:0/1763117284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f952806d510 msgr2=0x7f952809b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 --2- 172.21.15.114:0/1763117284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f952806d510 0x7f952809b910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9524009870 tx=0x7f952402b980 comp rx=0 tx=0).stop 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 -- 172.21.15.114:0/1763117284 shutdown_connections 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 --2- 172.21.15.114:0/1763117284 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95280d20d0 0x7f95280ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 --2- 172.21.15.114:0/1763117284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f952806d510 0x7f952809b910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 -- 172.21.15.114:0/1763117284 >> 172.21.15.114:0/1763117284 conn(0x7f95280d27c0 msgr2=0x7f95280d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 -- 172.21.15.114:0/1763117284 shutdown_connections 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.033+0000 7f952fec8640 1 -- 172.21.15.114:0/1763117284 wait complete. 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.034+0000 7f952fec8640 1 Processor -- start 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.034+0000 7f952fec8640 1 -- start start 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f952806d510 0x7f952815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f952806d8f0 0x7f952809e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 0x7f952809eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95280ce7e0 con 0x7f95280d20d0 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95280d1bb0 con 0x7f952806d8f0 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f95280ce960 con 0x7f952806d510 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 0x7f952809eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 0x7f952809eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60864/0 (socket says 172.21.15.114:60864) 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 -- 172.21.15.114:0/1907821639 learned_addr learned my addr 172.21.15.114:0/1907821639 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952dc64640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f952806d510 0x7f952815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952d463640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f952806d8f0 0x7f952809e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 -- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f952806d510 msgr2=0x7f952815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f952806d510 0x7f952815dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 -- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f952806d8f0 msgr2=0x7f952809e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f952806d8f0 0x7f952809e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 -- 172.21.15.114:0/1907821639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952809f700 con 0x7f95280d20d0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952e465640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 0x7f952809eba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f952000efc0 tx=0x7f952000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520018020 con 0x7f95280d20d0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520014480 con 0x7f95280d20d0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95281e9290 con 0x7f95280d20d0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520014870 con 0x7f95280d20d0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.035+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95281e9d70 con 0x7f95280d20d0 2024-04-13T02:44:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.036+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9528068c80 con 0x7f95280d20d0 2024-04-13T02:44:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.037+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9520005d10 con 0x7f95280d20d0 2024-04-13T02:44:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.037+0000 7f951e7fc640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f950c06c8f0 0x7f950c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.037+0000 7f952dc64640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f950c06c8f0 0x7f950c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.037+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f952008c110 con 0x7f95280d20d0 2024-04-13T02:44:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.037+0000 7f952dc64640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f950c06c8f0 0x7f950c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9524036000 tx=0x7f9524008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.041+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9520022070 con 0x7f95280d20d0 2024-04-13T02:44:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.219+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f95280d3540 con 0x7f95280d20d0 2024-04-13T02:44:37.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.220+0000 7f951e7fc640 1 -- 172.21.15.114:0/1907821639 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f9520010040 con 0x7f95280d20d0 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:44:37.221 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f950c06c8f0 msgr2=0x7f950c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f950c06c8f0 0x7f950c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9524036000 tx=0x7f9524008030 comp rx=0 tx=0).stop 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 msgr2=0x7f952809eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 0x7f952809eba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f952000efc0 tx=0x7f952000c490 comp rx=0 tx=0).stop 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 shutdown_connections 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95280d20d0 0x7f952809eba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f952806d8f0 0x7f952809e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f950c06c8f0 0x7f950c06edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 --2- 172.21.15.114:0/1907821639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f952806d510 0x7f952815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 >> 172.21.15.114:0/1907821639 conn(0x7f95280d27c0 msgr2=0x7f95280b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:37.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 shutdown_connections 2024-04-13T02:44:37.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.222+0000 7f952fec8640 1 -- 172.21.15.114:0/1907821639 wait complete. 2024-04-13T02:44:37.233 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-13T02:44:37.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 Processor -- start 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 -- start start 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6700d4560 0x7ff6700cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6700d3800 0x7ff6700cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6700cfe30 con 0x7ff67015ea90 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff6700b8900 con 0x7ff6700d4560 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.337+0000 7ff676f1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff6700cfbf0 con 0x7ff6700d3800 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff66ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6700d4560 0x7ff6700cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff674cba640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff67015ea90 0x7ff6700d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52102/0 (socket says 172.21.15.114:52102) 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff674cba640 1 -- 172.21.15.114:0/2513732177 learned_addr learned my addr 172.21.15.114:0/2513732177 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff66ffff640 1 -- 172.21.15.114:0/2513732177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6700d3800 msgr2=0x7ff6700cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff6754bb640 1 --2- 172.21.15.114:0/2513732177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6700d3800 0x7ff6700cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff66ffff640 1 --2- 172.21.15.114:0/2513732177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6700d3800 0x7ff6700cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff66ffff640 1 -- 172.21.15.114:0/2513732177 >> v1:172.21.15.114:6789/0 conn(0x7ff67015ea90 legacy=0x7ff6700d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff66f7fe640 1 -- 172.21.15.114:0/2513732177 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364925063 0 0) 0x7ff6700cfe30 con 0x7ff67015ea90 2024-04-13T02:44:37.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.338+0000 7ff66ffff640 1 -- 172.21.15.114:0/2513732177 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6700d2a40 con 0x7ff6700d4560 2024-04-13T02:44:37.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff66ffff640 1 --2- 172.21.15.114:0/2513732177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d4560 0x7ff6700cf170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0097a0 tx=0x7ff65c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7c5268ae1e5def server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:37.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff66f7fe640 1 -- 172.21.15.114:0/2513732177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c035020 con 0x7ff6700d4560 2024-04-13T02:44:37.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff66f7fe640 1 -- 172.21.15.114:0/2513732177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c031830 con 0x7ff6700d4560 2024-04-13T02:44:37.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff66f7fe640 1 -- 172.21.15.114:0/2513732177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c031c00 con 0x7ff6700d4560 2024-04-13T02:44:37.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 -- 172.21.15.114:0/2513732177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d4560 msgr2=0x7ff6700cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2513732177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d4560 0x7ff6700cf170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0097a0 tx=0x7ff65c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 -- 172.21.15.114:0/2513732177 shutdown_connections 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2513732177 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6700d3800 0x7ff6700cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2513732177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d4560 0x7ff6700cf170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 -- 172.21.15.114:0/2513732177 >> 172.21.15.114:0/2513732177 conn(0x7ff670073480 msgr2=0x7ff670073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 -- 172.21.15.114:0/2513732177 shutdown_connections 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.339+0000 7ff676f1e640 1 -- 172.21.15.114:0/2513732177 wait complete. 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.340+0000 7ff676f1e640 1 Processor -- start 2024-04-13T02:44:37.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.340+0000 7ff676f1e640 1 -- start start 2024-04-13T02:44:37.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff676f1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 0x7ff67014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff676f1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6700d4560 0x7ff670159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff676f1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff67015ea90 0x7ff6700b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff676f1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6700d32e0 con 0x7ff6700d3800 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff676f1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6700d3000 con 0x7ff6700d4560 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff676f1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff67015ee70 con 0x7ff67015ea90 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff674cba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 0x7ff67014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff674cba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 0x7ff67014af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60884/0 (socket says 172.21.15.114:60884) 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.341+0000 7ff674cba640 1 -- 172.21.15.114:0/2009256102 learned_addr learned my addr 172.21.15.114:0/2009256102 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff6754bb640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff67015ea90 0x7ff6700b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff66ffff640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6700d4560 0x7ff670159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff674cba640 1 -- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff67015ea90 msgr2=0x7ff6700b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff674cba640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff67015ea90 0x7ff6700b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff674cba640 1 -- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6700d4560 msgr2=0x7ff670159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff674cba640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6700d4560 0x7ff670159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:37.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff674cba640 1 -- 172.21.15.114:0/2009256102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67015a4f0 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff674cba640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 0x7ff67014af10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c430 tx=0x7ff66400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640074e0 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6640047e0 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664004bd0 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67015a7d0 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.342+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67015ad90 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.343+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff670068db0 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.344+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff664011070 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.344+0000 7ff66d7fa640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff65406c8f0 0x7ff65406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.344+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff66408b560 con 0x7ff6700d3800 2024-04-13T02:44:37.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.344+0000 7ff66ffff640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff65406c8f0 0x7ff65406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:37.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.344+0000 7ff66ffff640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff65406c8f0 0x7ff65406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff65c036000 tx=0x7ff65c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:37.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.348+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff664059c60 con 0x7ff6700d3800 2024-04-13T02:44:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:37.523+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff67015e140 con 0x7ff6700d3800 2024-04-13T02:44:38.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.197+0000 7ff66d7fa640 1 -- 172.21.15.114:0/2009256102 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7ff664059560 con 0x7ff6700d3800 2024-04-13T02:44:38.198 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-04-13T02:44:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.199+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff65406c8f0 msgr2=0x7ff65406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.199+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff65406c8f0 0x7ff65406edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff65c036000 tx=0x7ff65c008030 comp rx=0 tx=0).stop 2024-04-13T02:44:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.199+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 msgr2=0x7ff67014af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.199+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 0x7ff67014af10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c430 tx=0x7ff66400c8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 shutdown_connections 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff65406c8f0 0x7ff65406edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff67015ea90 0x7ff6700b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6700d4560 0x7ff670159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 --2- 172.21.15.114:0/2009256102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6700d3800 0x7ff67014af10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 >> 172.21.15.114:0/2009256102 conn(0x7ff670073480 msgr2=0x7ff6701605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 shutdown_connections 2024-04-13T02:44:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.200+0000 7ff676f1e640 1 -- 172.21.15.114:0/2009256102 wait complete. 2024-04-13T02:44:38.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-13T02:44:38.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.325+0000 7f2278ede640 1 Processor -- start 2024-04-13T02:44:38.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.325+0000 7f2278ede640 1 -- start start 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2278ede640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f227406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2278ede640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227406c250 con 0x7f22740b6780 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2278ede640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22740b0dd0 con 0x7f2274070040 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2278ede640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f227406f280 con 0x7f227406b930 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2271d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f22740b6780 0x7f22740b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52112/0 (socket says 172.21.15.114:52112) 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2271d9b640 1 -- 172.21.15.114:0/1960084377 learned_addr learned my addr 172.21.15.114:0/1960084377 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291386797 0 0) 0x7f227406c250 con 0x7f22740b6780 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f225c003520 con 0x7f22740b6780 2024-04-13T02:44:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227259c640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f227406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2465992833 0 0) 0x7f225c003520 con 0x7f22740b6780 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 msgr2=0x7f227406bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f227406bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 >> v1:172.21.15.130:6789/0 conn(0x7f2274070040 legacy=0x7f22740ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227406f560 con 0x7f22740b6780 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f2268001670 con 0x7f22740b6780 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227259c640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f227406bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 >> v1:172.21.15.114:6789/0 conn(0x7f22740b6780 legacy=0x7f22740b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f225c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c003fd0 0x7f225c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f227406f280 con 0x7f225c003fd0 2024-04-13T02:44:38.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f225c00bb20 con 0x7f225c004d40 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f225c00bd20 con 0x7f227406b930 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.326+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c003fd0 0x7f225c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f227259c640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f225c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2272d9d640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2271d9b640 1 -- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 msgr2=0x7f225c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f227406b930 0x7f225c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2271d9b640 1 -- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f225c004d40 msgr2=0x7f225c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2271d9b640 1 -- 172.21.15.114:0/1960084377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c003520 con 0x7f225c003fd0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.327+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c003fd0 0x7f225c004800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f226800c210 tx=0x7f225c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe5f71305ebecb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268007d30 con 0x7f225c003fd0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2268030070 con 0x7f225c003fd0 2024-04-13T02:44:38.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f227159a640 1 -- 172.21.15.114:0/1960084377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268005d70 con 0x7f225c003fd0 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2278ede640 1 -- 172.21.15.114:0/1960084377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c003fd0 msgr2=0x7f225c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2278ede640 1 --2- 172.21.15.114:0/1960084377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f225c003fd0 0x7f225c004800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f226800c210 tx=0x7f225c005830 comp rx=0 tx=0).stop 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2272d9d640 1 -- 172.21.15.114:0/1960084377 reap_dead start 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2278ede640 1 -- 172.21.15.114:0/1960084377 shutdown_connections 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2278ede640 1 -- 172.21.15.114:0/1960084377 >> 172.21.15.114:0/1960084377 conn(0x7f2274073720 msgr2=0x7f227409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2278ede640 1 -- 172.21.15.114:0/1960084377 shutdown_connections 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.328+0000 7f2278ede640 1 -- 172.21.15.114:0/1960084377 wait complete. 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.329+0000 7f2278ede640 1 Processor -- start 2024-04-13T02:44:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 -- start start 2024-04-13T02:44:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f225c003fd0 0x7f22741f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 0x7f227409b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227414c290 0x7f22740b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f227415eda0 con 0x7f22741f7a80 2024-04-13T02:44:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f227406fb20 con 0x7f227414c290 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2278ede640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f227415ef20 con 0x7f225c003fd0 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 0x7f227409b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 0x7f227409b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60902/0 (socket says 172.21.15.114:60902) 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2271d9b640 1 -- 172.21.15.114:0/1650562777 learned_addr learned my addr 172.21.15.114:0/1650562777 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f2272d9d640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227414c290 0x7f22740b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.330+0000 7f227259c640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f225c003fd0 0x7f22741f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2271d9b640 1 -- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f225c003fd0 msgr2=0x7f22741f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f225c003fd0 0x7f22741f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2271d9b640 1 -- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227414c290 msgr2=0x7f22740b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227414c290 0x7f22740b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2271d9b640 1 -- 172.21.15.114:0/1650562777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22741f8240 con 0x7f22741f7a80 2024-04-13T02:44:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2271d9b640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 0x7f227409b960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f226800c210 tx=0x7f2268001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268004bf0 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2268004d90 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741f8520 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268007270 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.331+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227414ba90 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.332+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227414bed0 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.332+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2268047020 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.333+0000 7f2262ffd640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f225406c8f0 0x7f225406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.333+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f22680aca20 con 0x7f22741f7a80 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.333+0000 7f227259c640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f225406c8f0 0x7f225406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.333+0000 7f227259c640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f225406c8f0 0x7f225406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2264006fa0 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:38.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.337+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f226807aa70 con 0x7f22741f7a80 2024-04-13T02:44:38.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:38.513+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f22740ae880 con 0x7f22741f7a80 2024-04-13T02:44:39.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.199+0000 7f2262ffd640 1 -- 172.21.15.114:0/1650562777 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f226807ed70 con 0x7f22741f7a80 2024-04-13T02:44:39.200 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-04-13T02:44:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f225406c8f0 msgr2=0x7f225406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f225406c8f0 0x7f225406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2264006fa0 tx=0x7f2264008040 comp rx=0 tx=0).stop 2024-04-13T02:44:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 msgr2=0x7f227409b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 0x7f227409b960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f226800c210 tx=0x7f2268001a40 comp rx=0 tx=0).stop 2024-04-13T02:44:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 shutdown_connections 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f227414c290 0x7f22740b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22741f7a80 0x7f227409b960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f225406c8f0 0x7f225406edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 --2- 172.21.15.114:0/1650562777 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f225c003fd0 0x7f22741f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 >> 172.21.15.114:0/1650562777 conn(0x7f2274073720 msgr2=0x7f22740b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 shutdown_connections 2024-04-13T02:44:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.202+0000 7f2278ede640 1 -- 172.21.15.114:0/1650562777 wait complete. 2024-04-13T02:44:39.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-13T02:44:39.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.334+0000 7ff7e80c8640 1 Processor -- start 2024-04-13T02:44:39.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.334+0000 7ff7e80c8640 1 -- start start 2024-04-13T02:44:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e80c8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7e006b930 0x7ff7e00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e80c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e00b04e0 con 0x7ff7e0145850 2024-04-13T02:44:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e80c8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7e00b07c0 con 0x7ff7e006bd10 2024-04-13T02:44:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e80c8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff7e00b1060 con 0x7ff7e006b930 2024-04-13T02:44:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e5e64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7e006b930 0x7ff7e00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e5663640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff7e0145850 0x7ff7e00b6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58798/0 (socket says 172.21.15.114:58798) 2024-04-13T02:44:39.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e5e64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7e006b930 0x7ff7e00afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52542/0 (socket says 172.21.15.114:52542) 2024-04-13T02:44:39.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.335+0000 7ff7e5663640 1 -- 172.21.15.114:0/760151399 learned_addr learned my addr 172.21.15.114:0/760151399 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:39.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e5e64640 1 -- 172.21.15.114:0/760151399 >> v1:172.21.15.130:6789/0 conn(0x7ff7e006bd10 legacy=0x7ff7e0166430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:39.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e5e64640 1 -- 172.21.15.114:0/760151399 >> v1:172.21.15.114:6789/0 conn(0x7ff7e0145850 legacy=0x7ff7e00b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:39.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e5e64640 1 -- 172.21.15.114:0/760151399 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e00b0aa0 con 0x7ff7e006b930 2024-04-13T02:44:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e5e64640 1 --2- 172.21.15.114:0/760151399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e006b930 0x7ff7e00afe20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009d90 tx=0x7ff7dc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dcc74183ca6e2f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e4e62640 1 -- 172.21.15.114:0/760151399 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc039070 con 0x7ff7e006b930 2024-04-13T02:44:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e4e62640 1 -- 172.21.15.114:0/760151399 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc02cc60 con 0x7ff7e006b930 2024-04-13T02:44:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.336+0000 7ff7e4e62640 1 -- 172.21.15.114:0/760151399 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc034660 con 0x7ff7e006b930 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 -- 172.21.15.114:0/760151399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e006b930 msgr2=0x7ff7e00afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/760151399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e006b930 0x7ff7e00afe20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009d90 tx=0x7ff7dc02beb0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 -- 172.21.15.114:0/760151399 shutdown_connections 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/760151399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e006b930 0x7ff7e00afe20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 -- 172.21.15.114:0/760151399 >> 172.21.15.114:0/760151399 conn(0x7ff7e0073720 msgr2=0x7ff7e009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 -- 172.21.15.114:0/760151399 shutdown_connections 2024-04-13T02:44:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.337+0000 7ff7e80c8640 1 -- 172.21.15.114:0/760151399 wait complete. 2024-04-13T02:44:39.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.338+0000 7ff7e80c8640 1 Processor -- start 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.338+0000 7ff7e80c8640 1 -- start start 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e80c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e006b930 0x7ff7e013b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e80c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7e006bd10 0x7ff7e006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e80c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 0x7ff7e009b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e80c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e00b5980 con 0x7ff7e00701d0 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e80c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e015ce60 con 0x7ff7e006b930 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e80c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff7e006c110 con 0x7ff7e006bd10 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 0x7ff7e009b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 0x7ff7e009b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52558/0 (socket says 172.21.15.114:52558) 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 -- 172.21.15.114:0/4156521336 learned_addr learned my addr 172.21.15.114:0/4156521336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e5e64640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e006b930 0x7ff7e013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e5663640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7e006bd10 0x7ff7e006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:39.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 -- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7e006bd10 msgr2=0x7ff7e006fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7e006bd10 0x7ff7e006fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 -- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e006b930 msgr2=0x7ff7e013b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e006b930 0x7ff7e013b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 -- 172.21.15.114:0/4156521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e0070800 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e5663640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7e006bd10 0x7ff7e006fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.339+0000 7ff7e6665640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 0x7ff7e009b6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800c390 tx=0x7ff7d800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.340+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8017070 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.340+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d80035f0 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.340+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e0070ae0 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.340+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d80039e0 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.340+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e014ffa0 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.341+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e0068c80 con 0x7ff7e00701d0 2024-04-13T02:44:39.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.341+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7d801a070 con 0x7ff7e00701d0 2024-04-13T02:44:39.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.342+0000 7ff7d67fc640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff7c406c8f0 0x7ff7c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:39.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.342+0000 7ff7e5e64640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff7c406c8f0 0x7ff7c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:39.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.342+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7ff7d808ae50 con 0x7ff7e00701d0 2024-04-13T02:44:39.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.342+0000 7ff7e5e64640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff7c406c8f0 0x7ff7c406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc036000 tx=0x7ff7dc030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:39.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.346+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7d8059370 con 0x7ff7e00701d0 2024-04-13T02:44:39.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:39.558+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff7e013b730 con 0x7ff7e00701d0 2024-04-13T02:44:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.217+0000 7ff7d67fc640 1 -- 172.21.15.114:0/4156521336 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff7d805f030 con 0x7ff7e00701d0 2024-04-13T02:44:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2024-04-13T02:44:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.223+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff7c406c8f0 msgr2=0x7ff7c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.223+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff7c406c8f0 0x7ff7c406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc036000 tx=0x7ff7dc030000 comp rx=0 tx=0).stop 2024-04-13T02:44:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.223+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 msgr2=0x7ff7e009b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.223+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 0x7ff7e009b6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800c390 tx=0x7ff7d800c850 comp rx=0 tx=0).stop 2024-04-13T02:44:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 shutdown_connections 2024-04-13T02:44:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e00701d0 0x7ff7e009b6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff7c406c8f0 0x7ff7c406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7e006bd10 0x7ff7e006fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 --2- 172.21.15.114:0/4156521336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e006b930 0x7ff7e013b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 >> 172.21.15.114:0/4156521336 conn(0x7ff7e0073720 msgr2=0x7ff7e0145c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.225+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 shutdown_connections 2024-04-13T02:44:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.226+0000 7ff7e80c8640 1 -- 172.21.15.114:0/4156521336 wait complete. 2024-04-13T02:44:40.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:40.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.345+0000 7f1f95f5e640 1 Processor -- start 2024-04-13T02:44:40.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.345+0000 7f1f95f5e640 1 -- start start 2024-04-13T02:44:40.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f95f5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f9015ee00 0x7f1f900cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f95f5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f900cfdc0 con 0x7f1f900cf6f0 2024-04-13T02:44:40.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f95f5e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f900d2d60 con 0x7f1f900d3e20 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f95f5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1f900cfba0 con 0x7f1f9015ee00 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f9015ee00 0x7f1f900cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1f900cf6f0 0x7f1f900b79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58812/0 (socket says 172.21.15.114:58812) 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8ffff640 1 -- 172.21.15.114:0/2914991941 learned_addr learned my addr 172.21.15.114:0/2914991941 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8effd640 1 -- 172.21.15.114:0/2914991941 >> v1:172.21.15.130:6789/0 conn(0x7f1f900d3e20 legacy=0x7f1f900d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8effd640 1 -- 172.21.15.114:0/2914991941 >> v1:172.21.15.114:6789/0 conn(0x7f1f900cf6f0 legacy=0x7f1f900b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8effd640 1 -- 172.21.15.114:0/2914991941 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f900d3040 con 0x7f1f9015ee00 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.346+0000 7f1f8e7fc640 1 -- 172.21.15.114:0/2914991941 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494662893 0 0) 0x7f1f900cfdc0 con 0x7f1f900cf6f0 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f8effd640 1 --2- 172.21.15.114:0/2914991941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9015ee00 0x7f1f900cf1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f840097a0 tx=0x7f1f8402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76796e2262773f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f8e7fc640 1 -- 172.21.15.114:0/2914991941 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84034070 con 0x7f1f9015ee00 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f8e7fc640 1 -- 172.21.15.114:0/2914991941 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84030610 con 0x7f1f9015ee00 2024-04-13T02:44:40.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f8e7fc640 1 -- 172.21.15.114:0/2914991941 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840309e0 con 0x7f1f9015ee00 2024-04-13T02:44:40.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f95f5e640 1 -- 172.21.15.114:0/2914991941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9015ee00 msgr2=0x7f1f900cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/2914991941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9015ee00 0x7f1f900cf1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f840097a0 tx=0x7f1f8402b960 comp rx=0 tx=0).stop 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f95f5e640 1 -- 172.21.15.114:0/2914991941 shutdown_connections 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/2914991941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f9015ee00 0x7f1f900cf1b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.347+0000 7f1f95f5e640 1 -- 172.21.15.114:0/2914991941 >> 172.21.15.114:0/2914991941 conn(0x7f1f9006d470 msgr2=0x7f1f9006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.348+0000 7f1f95f5e640 1 -- 172.21.15.114:0/2914991941 shutdown_connections 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.348+0000 7f1f95f5e640 1 -- 172.21.15.114:0/2914991941 wait complete. 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 Processor -- start 2024-04-13T02:44:40.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 -- start start 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f900cf6f0 0x7f1f90150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 0x7f1f900b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f9015ee00 0x7f1f901f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d2b10 con 0x7f1f900d3e20 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900d3a90 con 0x7f1f9015ee00 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.349+0000 7f1f95f5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f900d33b0 con 0x7f1f900cf6f0 2024-04-13T02:44:40.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 0x7f1f900b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 0x7f1f900b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52590/0 (socket says 172.21.15.114:52590) 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 -- 172.21.15.114:0/995512752 learned_addr learned my addr 172.21.15.114:0/995512752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8f7fe640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f900cf6f0 0x7f1f90150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8ffff640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f9015ee00 0x7f1f901f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 -- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f900cf6f0 msgr2=0x7f1f90150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f900cf6f0 0x7f1f90150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 -- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f9015ee00 msgr2=0x7f1f901f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f9015ee00 0x7f1f901f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 -- 172.21.15.114:0/995512752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f901f5100 con 0x7f1f900d3e20 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8f7fe640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f900cf6f0 0x7f1f90150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f8effd640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 0x7f1f900b8c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f840098c0 tx=0x7f1f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84047070 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84039a10 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f901f53e0 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84034040 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.350+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f900b7980 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.351+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f90068c80 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.352+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f8404a070 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.352+0000 7f1f77fff640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f7c06c8f0 0x7f1f7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.352+0000 7f1f8f7fe640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f7c06c8f0 0x7f1f7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.352+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f1f840ad6e0 con 0x7f1f900d3e20 2024-04-13T02:44:40.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.352+0000 7f1f8f7fe640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f7c06c8f0 0x7f1f7c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f80003eb0 tx=0x7f1f80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.356+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f8407bba0 con 0x7f1f900d3e20 2024-04-13T02:44:40.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.532+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f9006dc20 con 0x7f1f900d3e20 2024-04-13T02:44:40.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.533+0000 7f1f77fff640 1 -- 172.21.15.114:0/995512752 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f1f8407b4a0 con 0x7f1f900d3e20 2024-04-13T02:44:40.534 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:40.535 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:39.559629+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.535+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f7c06c8f0 msgr2=0x7f1f7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.535+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f7c06c8f0 0x7f1f7c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f80003eb0 tx=0x7f1f80009040 comp rx=0 tx=0).stop 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 msgr2=0x7f1f900b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 0x7f1f900b8c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1f840098c0 tx=0x7f1f840046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 shutdown_connections 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f9015ee00 0x7f1f901f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f900d3e20 0x7f1f900b8c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f7c06c8f0 0x7f1f7c06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 --2- 172.21.15.114:0/995512752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f900cf6f0 0x7f1f90150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 >> 172.21.15.114:0/995512752 conn(0x7f1f9006d470 msgr2=0x7f1f900cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 shutdown_connections 2024-04-13T02:44:40.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.536+0000 7f1f95f5e640 1 -- 172.21.15.114:0/995512752 wait complete. 2024-04-13T02:44:40.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.645+0000 7fbd8bb88640 1 Processor -- start 2024-04-13T02:44:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.646+0000 7fbd8bb88640 1 -- start start 2024-04-13T02:44:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.646+0000 7fbd8bb88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.646+0000 7fbd8bb88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd840b3e10 0x7fbd8415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.646+0000 7fbd8bb88640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd840b4be0 con 0x7fbd841461f0 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.646+0000 7fbd8bb88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbd840a9640 con 0x7fbd840b3e10 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.646+0000 7fbd8bb88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbd840b4620 con 0x7fbd840cefc0 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd840b3e10 0x7fbd8415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd840b3e10 0x7fbd8415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52602/0 (socket says 172.21.15.114:52602) 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd89924640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbd841461f0 0x7fbd840ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58822/0 (socket says 172.21.15.114:58822) 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 -- 172.21.15.114:0/936842958 learned_addr learned my addr 172.21.15.114:0/936842958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd89123640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 -- 172.21.15.114:0/936842958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 msgr2=0x7fbd840b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 -- 172.21.15.114:0/936842958 >> v1:172.21.15.114:6789/0 conn(0x7fbd841461f0 legacy=0x7fbd840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd8a125640 1 -- 172.21.15.114:0/936842958 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd840b4900 con 0x7fbd840b3e10 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd88922640 1 -- 172.21.15.114:0/936842958 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129341622 0 0) 0x7fbd840b4be0 con 0x7fbd841461f0 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.647+0000 7fbd89123640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8a125640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840b3e10 0x7fbd8415d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009e80 tx=0x7fbd7c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b40700639ff4b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd88922640 1 -- 172.21.15.114:0/936842958 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c02caf0 con 0x7fbd840b3e10 2024-04-13T02:44:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd88922640 1 -- 172.21.15.114:0/936842958 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c02cc90 con 0x7fbd840b3e10 2024-04-13T02:44:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd88922640 1 -- 172.21.15.114:0/936842958 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c034610 con 0x7fbd840b3e10 2024-04-13T02:44:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 -- 172.21.15.114:0/936842958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840b3e10 msgr2=0x7fbd8415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840b3e10 0x7fbd8415d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009e80 tx=0x7fbd7c02bf50 comp rx=0 tx=0).stop 2024-04-13T02:44:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 -- 172.21.15.114:0/936842958 shutdown_connections 2024-04-13T02:44:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840b3e10 0x7fbd8415d7b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/936842958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 -- 172.21.15.114:0/936842958 >> 172.21.15.114:0/936842958 conn(0x7fbd840b27b0 msgr2=0x7fbd840b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 -- 172.21.15.114:0/936842958 shutdown_connections 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.648+0000 7fbd8bb88640 1 -- 172.21.15.114:0/936842958 wait complete. 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.649+0000 7fbd8bb88640 1 Processor -- start 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.649+0000 7fbd8bb88640 1 -- start start 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8bb88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b3e10 0x7fbd8413c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8bb88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8bb88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 0x7fbd840ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8bb88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841465d0 con 0x7fbd841461f0 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8bb88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8415d290 con 0x7fbd840b3e10 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8bb88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbd840b42a0 con 0x7fbd840cefc0 2024-04-13T02:44:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8a125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 0x7fbd840ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8a125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 0x7fbd840ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52606/0 (socket says 172.21.15.114:52606) 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd8a125640 1 -- 172.21.15.114:0/3370872362 learned_addr learned my addr 172.21.15.114:0/3370872362 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd89123640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.650+0000 7fbd89924640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b3e10 0x7fbd8413c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8a125640 1 -- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 msgr2=0x7fbd840a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8a125640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8a125640 1 -- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b3e10 msgr2=0x7fbd8413c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8a125640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b3e10 0x7fbd8413c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8a125640 1 -- 172.21.15.114:0/3370872362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd840aa020 con 0x7fbd841461f0 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd89123640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd89924640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b3e10 0x7fbd8413c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8a125640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 0x7fbd840ab0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009fa0 tx=0x7fbd7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c043020 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c03e450 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd840aa300 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c03e840 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.651+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd840aa8c0 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.652+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd84073400 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.652+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd7c046020 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.653+0000 7fbd7a7fc640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd6806c920 0x7fbd6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.653+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fbd7c0ae3c0 con 0x7fbd841461f0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.653+0000 7fbd89924640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd6806c920 0x7fbd6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.653+0000 7fbd89924640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd6806c920 0x7fbd6806ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000f60 tx=0x7fbd80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.657+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd84073400 con 0x7fbd841461f0 2024-04-13T02:44:40.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.836+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd840b0240 con 0x7fbd841461f0 2024-04-13T02:44:40.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.837+0000 7fbd7a7fc640 1 -- 172.21.15.114:0/3370872362 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7fbd7c04d030 con 0x7fbd841461f0 2024-04-13T02:44:40.838 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:40.839 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:39.559629+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd6806c920 msgr2=0x7fbd6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd6806c920 0x7fbd6806ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000f60 tx=0x7fbd80009040 comp rx=0 tx=0).stop 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 msgr2=0x7fbd840ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 0x7fbd840ab0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009fa0 tx=0x7fbd7c004a40 comp rx=0 tx=0).stop 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 shutdown_connections 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd841461f0 0x7fbd840ab0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd6806c920 0x7fbd6806ede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd840cefc0 0x7fbd840a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 --2- 172.21.15.114:0/3370872362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd840b3e10 0x7fbd8413c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.839+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 >> 172.21.15.114:0/3370872362 conn(0x7fbd840b27b0 msgr2=0x7fbd840b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.840+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 shutdown_connections 2024-04-13T02:44:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.840+0000 7fbd8bb88640 1 -- 172.21.15.114:0/3370872362 wait complete. 2024-04-13T02:44:40.851 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-13T02:44:40.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.954+0000 7f090cba3640 1 Processor -- start 2024-04-13T02:44:40.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.954+0000 7f090cba3640 1 -- start start 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f090cba3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f09080d18d0 0x7f09080d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f090cba3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09080cf1a0 0x7f09080cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f090cba3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090815f130 con 0x7f090815ed50 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f090cba3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f09080b7e40 con 0x7f09080cf1a0 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f090cba3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f09080d3210 con 0x7f09080d18d0 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09080cf1a0 0x7f09080cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09080cf1a0 0x7f09080cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52614/0 (socket says 172.21.15.114:52614) 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 -- 172.21.15.114:0/3338657268 learned_addr learned my addr 172.21.15.114:0/3338657268 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f090659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f090815ed50 0x7f09080d2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58830/0 (socket says 172.21.15.114:58830) 2024-04-13T02:44:40.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0905d9b640 1 --2- 172.21.15.114:0/3338657268 >> v2:172.21.15.130:3300/0 conn(0x7f09080d18d0 0x7f09080d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 -- 172.21.15.114:0/3338657268 >> v2:172.21.15.130:3300/0 conn(0x7f09080d18d0 msgr2=0x7f09080d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 --2- 172.21.15.114:0/3338657268 >> v2:172.21.15.130:3300/0 conn(0x7f09080d18d0 0x7f09080d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 -- 172.21.15.114:0/3338657268 >> v1:172.21.15.114:6789/0 conn(0x7f090815ed50 legacy=0x7f09080d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0906d9d640 1 -- 172.21.15.114:0/3338657268 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09080d34e0 con 0x7f09080cf1a0 2024-04-13T02:44:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.955+0000 7f0905d9b640 1 --2- 172.21.15.114:0/3338657268 >> v2:172.21.15.130:3300/0 conn(0x7f09080d18d0 0x7f09080d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:40.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.956+0000 7f0906d9d640 1 --2- 172.21.15.114:0/3338657268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09080cf610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f090808da90 tx=0x7f090002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca69e6f033ccf17d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.956+0000 7f090559a640 1 -- 172.21.15.114:0/3338657268 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900035020 con 0x7f09080cf1a0 2024-04-13T02:44:40.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.956+0000 7f090559a640 1 -- 172.21.15.114:0/3338657268 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0900031870 con 0x7f09080cf1a0 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.956+0000 7f090559a640 1 -- 172.21.15.114:0/3338657268 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900031c40 con 0x7f09080cf1a0 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.956+0000 7f090cba3640 1 -- 172.21.15.114:0/3338657268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 msgr2=0x7f09080cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.956+0000 7f090cba3640 1 --2- 172.21.15.114:0/3338657268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09080cf610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f090808da90 tx=0x7f090002b910 comp rx=0 tx=0).stop 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.957+0000 7f090cba3640 1 -- 172.21.15.114:0/3338657268 shutdown_connections 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.957+0000 7f090cba3640 1 --2- 172.21.15.114:0/3338657268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09080cf610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.957+0000 7f090cba3640 1 --2- 172.21.15.114:0/3338657268 >> v2:172.21.15.130:3300/0 conn(0x7f09080d18d0 0x7f09080d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.957+0000 7f090cba3640 1 -- 172.21.15.114:0/3338657268 >> 172.21.15.114:0/3338657268 conn(0x7f090806d400 msgr2=0x7f090806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.957+0000 7f090cba3640 1 -- 172.21.15.114:0/3338657268 shutdown_connections 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.957+0000 7f090cba3640 1 -- 172.21.15.114:0/3338657268 wait complete. 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.958+0000 7f090cba3640 1 Processor -- start 2024-04-13T02:44:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.958+0000 7f090cba3640 1 -- start start 2024-04-13T02:44:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.958+0000 7f090cba3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09081f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09080d18d0 0x7f09081e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f090815ed50 0x7f09081e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09080b79d0 con 0x7f09080cf1a0 2024-04-13T02:44:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09080d3aa0 con 0x7f09080d18d0 2024-04-13T02:44:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f09080b7b50 con 0x7f090815ed50 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09081f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09081f48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52624/0 (socket says 172.21.15.114:52624) 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 -- 172.21.15.114:0/2892470906 learned_addr learned my addr 172.21.15.114:0/2892470906 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f0906d9d640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f090815ed50 0x7f09081e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f0905d9b640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09080d18d0 0x7f09081e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 -- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f090815ed50 msgr2=0x7f09081e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f090815ed50 0x7f09081e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 -- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09080d18d0 msgr2=0x7f09081e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09080d18d0 0x7f09081e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 -- 172.21.15.114:0/2892470906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09080b4e00 con 0x7f09080cf1a0 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f0905d9b640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09080d18d0 0x7f09081e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090659c640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09081f48c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c760 tx=0x7f08f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8017070 con 0x7f09080cf1a0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f800a640 con 0x7f09080cf1a0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09080b50e0 con 0x7f09080cf1a0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f800aa10 con 0x7f09080cf1a0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.959+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09080b56a0 con 0x7f09080cf1a0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.960+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0908068c80 con 0x7f09080cf1a0 2024-04-13T02:44:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.961+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08f801a070 con 0x7f09080cf1a0 2024-04-13T02:44:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.961+0000 7f08f6ffd640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f08e806c8f0 0x7f08e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.961+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f08f808b0a0 con 0x7f09080cf1a0 2024-04-13T02:44:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.961+0000 7f0905d9b640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f08e806c8f0 0x7f08e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.962+0000 7f0905d9b640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f08e806c8f0 0x7f08e806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09080cb4a0 tx=0x7f08fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:40.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:40.966+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08f8058e80 con 0x7f09080cf1a0 2024-04-13T02:44:41.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.178+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f09080cfcd0 con 0x7f09080cf1a0 2024-04-13T02:44:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.217+0000 7f08f6ffd640 1 -- 172.21.15.114:0/2892470906 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f08f805d180 con 0x7f09080cf1a0 2024-04-13T02:44:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f08e806c8f0 msgr2=0x7f08e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f08e806c8f0 0x7f08e806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09080cb4a0 tx=0x7f08fc008040 comp rx=0 tx=0).stop 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 msgr2=0x7f09081f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09081f48c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c760 tx=0x7f08f800cc20 comp rx=0 tx=0).stop 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 shutdown_connections 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f08e806c8f0 0x7f08e806edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f090815ed50 0x7f09081e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09080d18d0 0x7f09081e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 --2- 172.21.15.114:0/2892470906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09080cf1a0 0x7f09081f48c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 >> 172.21.15.114:0/2892470906 conn(0x7f090806d400 msgr2=0x7f090806d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 shutdown_connections 2024-04-13T02:44:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.219+0000 7f090cba3640 1 -- 172.21.15.114:0/2892470906 wait complete. 2024-04-13T02:44:41.232 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-13T02:44:41.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-13T02:44:41.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.336+0000 7f4d77b7b640 1 Processor -- start 2024-04-13T02:44:41.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.336+0000 7f4d77b7b640 1 -- start start 2024-04-13T02:44:41.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d77b7b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4d70160050 0x7f4d70071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:41.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d77b7b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 0x7f4d700d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:41.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d77b7b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7009b740 con 0x7f4d700d0e50 2024-04-13T02:44:41.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d77b7b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700cd4d0 con 0x7f4d70160050 2024-04-13T02:44:41.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d77b7b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700d3660 con 0x7f4d70072150 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75917640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4d70160050 0x7f4d70071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 0x7f4d700d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 0x7f4d700d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:40968/0 (socket says 172.21.15.114:40968) 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75917640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4d70160050 0x7f4d70071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59322/0 (socket says 172.21.15.114:59322) 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 -- 172.21.15.114:0/3349689348 learned_addr learned my addr 172.21.15.114:0/3349689348 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d76118640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4d700d0e50 0x7f4d70070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47582/0 (socket says 172.21.15.114:47582) 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 -- 172.21.15.114:0/3349689348 >> v2:172.21.15.130:3300/0 conn(0x7f4d70160050 msgr2=0x7f4d70071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 --2- 172.21.15.114:0/3349689348 >> v2:172.21.15.130:3300/0 conn(0x7f4d70160050 0x7f4d70071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 -- 172.21.15.114:0/3349689348 >> v1:172.21.15.130:6789/0 conn(0x7f4d700d0e50 legacy=0x7f4d70070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:41.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.337+0000 7f4d75116640 1 -- 172.21.15.114:0/3349689348 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70160430 con 0x7f4d70072150 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.338+0000 7f4d75116640 1 --2- 172.21.15.114:0/3349689348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 0x7f4d700d0910 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd64939c76b3f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.338+0000 7f4d74915640 1 -- 172.21.15.114:0/3349689348 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d600317c0 con 0x7f4d70072150 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.338+0000 7f4d74915640 1 -- 172.21.15.114:0/3349689348 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60037070 con 0x7f4d70072150 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.338+0000 7f4d74915640 1 -- 172.21.15.114:0/3349689348 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60031b80 con 0x7f4d70072150 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 -- 172.21.15.114:0/3349689348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 msgr2=0x7f4d700d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/3349689348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 0x7f4d700d0910 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6002b860 comp rx=0 tx=0).stop 2024-04-13T02:44:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 -- 172.21.15.114:0/3349689348 shutdown_connections 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/3349689348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70072150 0x7f4d700d0910 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/3349689348 >> v2:172.21.15.130:3300/0 conn(0x7f4d70160050 0x7f4d70071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 -- 172.21.15.114:0/3349689348 >> 172.21.15.114:0/3349689348 conn(0x7f4d700d2750 msgr2=0x7f4d700d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 -- 172.21.15.114:0/3349689348 shutdown_connections 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.339+0000 7f4d77b7b640 1 -- 172.21.15.114:0/3349689348 wait complete. 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.340+0000 7f4d77b7b640 1 Processor -- start 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.340+0000 7f4d77b7b640 1 -- start start 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 0x7f4d700c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d700d0e50 0x7f4d7015b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70160050 0x7f4d700b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700cd0f0 con 0x7f4d70072150 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7009bcc0 con 0x7f4d700d0e50 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700ce970 con 0x7f4d70160050 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 0x7f4d700c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 0x7f4d700c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52630/0 (socket says 172.21.15.114:52630) 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 -- 172.21.15.114:0/2156005310 learned_addr learned my addr 172.21.15.114:0/2156005310 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75116640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d700d0e50 0x7f4d7015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d76118640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70160050 0x7f4d700b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 -- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70160050 msgr2=0x7f4d700b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70160050 0x7f4d700b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 -- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d700d0e50 msgr2=0x7f4d7015b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d700d0e50 0x7f4d7015b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 -- 172.21.15.114:0/2156005310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700b5e00 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d75917640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 0x7f4d700c8f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e870 tx=0x7f4d6c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c017070 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6c00c940 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d700b60e0 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00cd30 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.341+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d700b6980 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.343+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d700b62b0 con 0x7f4d70072150 2024-04-13T02:44:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.343+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d6c01a070 con 0x7f4d70072150 2024-04-13T02:44:41.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.343+0000 7f4d667fc640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d5406c8f0 0x7f4d5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:41.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.343+0000 7f4d75116640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d5406c8f0 0x7f4d5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:41.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.343+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d6c08bc60 con 0x7f4d70072150 2024-04-13T02:44:41.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.344+0000 7f4d75116640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d5406c8f0 0x7f4d5406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d60036000 tx=0x7f4d6003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.348+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d6c059ad0 con 0x7f4d70072150 2024-04-13T02:44:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:41.559+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4d700d2300 con 0x7f4d70072150 2024-04-13T02:44:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.228+0000 7f4d667fc640 1 -- 172.21.15.114:0/2156005310 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f4d700d2300 con 0x7f4d70072150 2024-04-13T02:44:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d5406c8f0 msgr2=0x7f4d5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d5406c8f0 0x7f4d5406edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d60036000 tx=0x7f4d6003d040 comp rx=0 tx=0).stop 2024-04-13T02:44:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 msgr2=0x7f4d700c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 0x7f4d700c8f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e870 tx=0x7f4d6c00ed30 comp rx=0 tx=0).stop 2024-04-13T02:44:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 shutdown_connections 2024-04-13T02:44:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d5406c8f0 0x7f4d5406edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4d70160050 0x7f4d700b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d700d0e50 0x7f4d7015b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 --2- 172.21.15.114:0/2156005310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d70072150 0x7f4d700c8f10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 >> 172.21.15.114:0/2156005310 conn(0x7f4d700d2750 msgr2=0x7f4d700b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 shutdown_connections 2024-04-13T02:44:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.231+0000 7f4d77b7b640 1 -- 172.21.15.114:0/2156005310 wait complete. 2024-04-13T02:44:42.244 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-13T02:44:42.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:44:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.346+0000 7f3a51b1e640 1 Processor -- start 2024-04-13T02:44:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.346+0000 7f3a51b1e640 1 -- start start 2024-04-13T02:44:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a51b1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a4c15ee20 0x7f3a4c0d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a51b1e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a4c15f200 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a51b1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a4c0b6500 con 0x7f3a4c0cfc50 2024-04-13T02:44:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a51b1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3a4c0b67e0 con 0x7f3a4c15ee20 2024-04-13T02:44:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3a4c0d1f50 0x7f3a4c0b7ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58846/0 (socket says 172.21.15.114:58846) 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4bfff640 1 -- 172.21.15.114:0/2882548111 learned_addr learned my addr 172.21.15.114:0/2882548111 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4b7fe640 1 --2- 172.21.15.114:0/2882548111 >> v2:172.21.15.130:3300/0 conn(0x7f3a4c15ee20 0x7f3a4c0d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006727743 0 0) 0x7f3a4c15f200 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a34003520 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243774327 0 0) 0x7f3a4c0b6500 con 0x7f3a4c0cfc50 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a4c15f200 con 0x7f3a4c0cfc50 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1079401739 0 0) 0x7f3a34003520 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4b7fe640 1 -- 172.21.15.114:0/2882548111 >> v1:172.21.15.130:6789/0 conn(0x7f3a4c0cfc50 legacy=0x7f3a4c0d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4b7fe640 1 -- 172.21.15.114:0/2882548111 >> v1:172.21.15.114:6789/0 conn(0x7f3a4c0d1f50 legacy=0x7f3a4c0b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.347+0000 7f3a4b7fe640 1 -- 172.21.15.114:0/2882548111 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c0b6ac0 con 0x7f3a4c15ee20 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.348+0000 7f3a4b7fe640 1 --2- 172.21.15.114:0/2882548111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c15ee20 0x7f3a4c0d3fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0097a0 tx=0x7f3a3c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ca53d9cd68431c server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.348+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c037070 con 0x7f3a4c15ee20 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.348+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3c030510 con 0x7f3a4c15ee20 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.348+0000 7f3a4a7fc640 1 -- 172.21.15.114:0/2882548111 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440019f0 con 0x7f3a4c15ee20 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 -- 172.21.15.114:0/2882548111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c15ee20 msgr2=0x7f3a4c0d3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/2882548111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c15ee20 0x7f3a4c0d3fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0097a0 tx=0x7f3a3c02b710 comp rx=0 tx=0).stop 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 -- 172.21.15.114:0/2882548111 shutdown_connections 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/2882548111 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c15ee20 0x7f3a4c0d3fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 -- 172.21.15.114:0/2882548111 >> 172.21.15.114:0/2882548111 conn(0x7f3a4c06d490 msgr2=0x7f3a4c06d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 -- 172.21.15.114:0/2882548111 shutdown_connections 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.349+0000 7f3a51b1e640 1 -- 172.21.15.114:0/2882548111 wait complete. 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.350+0000 7f3a51b1e640 1 Processor -- start 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.350+0000 7f3a51b1e640 1 -- start start 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c0cfc50 0x7f3a4c158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 0x7f3a4c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a4c15ee20 0x7f3a4c160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c0d4510 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c0b7080 con 0x7f3a4c0cfc50 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4c0d4690 con 0x7f3a4c15ee20 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 0x7f3a4c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 0x7f3a4c160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52640/0 (socket says 172.21.15.114:52640) 2024-04-13T02:44:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 -- 172.21.15.114:0/4054499462 learned_addr learned my addr 172.21.15.114:0/4054499462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4b7fe640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c0cfc50 0x7f3a4c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4bfff640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a4c15ee20 0x7f3a4c160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 -- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a4c15ee20 msgr2=0x7f3a4c160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a4c15ee20 0x7f3a4c160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 -- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c0cfc50 msgr2=0x7f3a4c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c0cfc50 0x7f3a4c158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 -- 172.21.15.114:0/4054499462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c161480 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4b7fe640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c0cfc50 0x7f3a4c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a4affd640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 0x7f3a4c160910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c490 tx=0x7f3a4000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a400052d0 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a40005470 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4c161760 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40012870 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.351+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4c161d20 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.352+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4c068c80 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.353+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a40012a10 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.353+0000 7f3a33fff640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a3806c920 0x7f3a3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.353+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3a4008b810 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.353+0000 7f3a4b7fe640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a3806c920 0x7f3a3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.354+0000 7f3a4b7fe640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a3806c920 0x7f3a3806ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c034000 tx=0x7f3a3c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.358+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a40059bc0 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.570+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a4c0b3fc0 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.570+0000 7f3a33fff640 1 -- 172.21.15.114:0/4054499462 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f3a400594c0 con 0x7f3a4c0d1f50 2024-04-13T02:44:42.571 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:42.572 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:44:42.572 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:44:42.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.572+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a3806c920 msgr2=0x7f3a3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.572+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a3806c920 0x7f3a3806ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c034000 tx=0x7f3a3c008030 comp rx=0 tx=0).stop 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.572+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 msgr2=0x7f3a4c160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.572+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 0x7f3a4c160910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c490 tx=0x7f3a4000c950 comp rx=0 tx=0).stop 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 shutdown_connections 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a3806c920 0x7f3a3806ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a4c15ee20 0x7f3a4c160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a4c0d1f50 0x7f3a4c160910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 --2- 172.21.15.114:0/4054499462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a4c0cfc50 0x7f3a4c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 >> 172.21.15.114:0/4054499462 conn(0x7f3a4c06d490 msgr2=0x7f3a4c0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 shutdown_connections 2024-04-13T02:44:42.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.573+0000 7f3a51b1e640 1 -- 172.21.15.114:0/4054499462 wait complete. 2024-04-13T02:44:42.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:42.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.683+0000 7ff02c755640 1 Processor -- start 2024-04-13T02:44:42.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.683+0000 7ff02c755640 1 -- start start 2024-04-13T02:44:42.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02c755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff02415e7c0 0x7ff0240b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02c755640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0240b4be0 con 0x7ff0241461f0 2024-04-13T02:44:42.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02c755640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0240b4620 con 0x7ff0240cefc0 2024-04-13T02:44:42.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02c755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff0240a9640 con 0x7ff02415e7c0 2024-04-13T02:44:42.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02a4f1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff0241461f0 0x7ff0240ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58860/0 (socket says 172.21.15.114:58860) 2024-04-13T02:44:42.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02a4f1640 1 -- 172.21.15.114:0/393443049 learned_addr learned my addr 172.21.15.114:0/393443049 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02acf2640 1 --2- 172.21.15.114:0/393443049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff02415e7c0 0x7ff0240b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256087475 0 0) 0x7ff0240b4be0 con 0x7ff0241461f0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff010003520 con 0x7ff0241461f0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235479791 0 0) 0x7ff0240b4620 con 0x7ff0240cefc0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0240b4be0 con 0x7ff0240cefc0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3529510754 0 0) 0x7ff010003520 con 0x7ff0241461f0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02acf2640 1 -- 172.21.15.114:0/393443049 >> v1:172.21.15.130:6789/0 conn(0x7ff0240cefc0 legacy=0x7ff0240b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02acf2640 1 -- 172.21.15.114:0/393443049 >> v1:172.21.15.114:6789/0 conn(0x7ff0241461f0 legacy=0x7ff0240ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.684+0000 7ff02acf2640 1 -- 172.21.15.114:0/393443049 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0240b4900 con 0x7ff02415e7c0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.685+0000 7ff02acf2640 1 --2- 172.21.15.114:0/393443049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff02415e7c0 0x7ff0240b3fe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009dc0 tx=0x7ff01c02be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed76f964860f85a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.685+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c039070 con 0x7ff02415e7c0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.685+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c02c9a0 con 0x7ff02415e7c0 2024-04-13T02:44:42.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.685+0000 7ff0294ef640 1 -- 172.21.15.114:0/393443049 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020001690 con 0x7ff02415e7c0 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 -- 172.21.15.114:0/393443049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff02415e7c0 msgr2=0x7ff0240b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 --2- 172.21.15.114:0/393443049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff02415e7c0 0x7ff0240b3fe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009dc0 tx=0x7ff01c02be70 comp rx=0 tx=0).stop 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 -- 172.21.15.114:0/393443049 shutdown_connections 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 --2- 172.21.15.114:0/393443049 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff02415e7c0 0x7ff0240b3fe0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 -- 172.21.15.114:0/393443049 >> 172.21.15.114:0/393443049 conn(0x7ff0240b27b0 msgr2=0x7ff0240b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 -- 172.21.15.114:0/393443049 shutdown_connections 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.686+0000 7ff02c755640 1 -- 172.21.15.114:0/393443049 wait complete. 2024-04-13T02:44:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.687+0000 7ff02c755640 1 Processor -- start 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.687+0000 7ff02c755640 1 -- start start 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02c755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0240cefc0 0x7ff02415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02c755640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0241461f0 0x7ff0241450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02c755640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 0x7ff024143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02c755640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff0241465d0 con 0x7ff02415e7c0 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02c755640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff02415d290 con 0x7ff0241461f0 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02c755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff024167460 con 0x7ff0240cefc0 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 0x7ff024143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 0x7ff024143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52656/0 (socket says 172.21.15.114:52656) 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 -- 172.21.15.114:0/58013499 learned_addr learned my addr 172.21.15.114:0/58013499 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02a4f1640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0240cefc0 0x7ff02415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff029cf0640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0241461f0 0x7ff0241450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 -- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0240cefc0 msgr2=0x7ff02415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0240cefc0 0x7ff02415c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 -- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0241461f0 msgr2=0x7ff0241450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0241461f0 0x7ff0241450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02acf2640 1 -- 172.21.15.114:0/58013499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff024144030 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff02a4f1640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0240cefc0 0x7ff02415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.688+0000 7ff029cf0640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0241461f0 0x7ff0241450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.689+0000 7ff02acf2640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 0x7ff024143570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff01c02c480 tx=0x7ff01c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.689+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c044020 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.689+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c034c40 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.689+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c039040 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.689+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff024144310 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.689+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0241448d0 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.690+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff024068c80 con 0x7ff02415e7c0 2024-04-13T02:44:42.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.690+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff01c047020 con 0x7ff02415e7c0 2024-04-13T02:44:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.691+0000 7ff01affd640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff00806c8f0 0x7ff00806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.691+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff01c0ae2f0 con 0x7ff02415e7c0 2024-04-13T02:44:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.691+0000 7ff02a4f1640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff00806c8f0 0x7ff00806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.691+0000 7ff02a4f1640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff00806c8f0 0x7ff00806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff020001800 tx=0x7ff0200015f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.695+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff01c04e030 con 0x7ff02415e7c0 2024-04-13T02:44:42.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.870+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff02415c790 con 0x7ff02415e7c0 2024-04-13T02:44:42.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.871+0000 7ff01affd640 1 -- 172.21.15.114:0/58013499 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7ff01c07c720 con 0x7ff02415e7c0 2024-04-13T02:44:42.872 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:42.872 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:42.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff00806c8f0 msgr2=0x7ff00806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff00806c8f0 0x7ff00806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff020001800 tx=0x7ff0200015f0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 msgr2=0x7ff024143570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 0x7ff024143570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff01c02c480 tx=0x7ff01c004a40 comp rx=0 tx=0).stop 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 shutdown_connections 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02415e7c0 0x7ff024143570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0241461f0 0x7ff0241450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff00806c8f0 0x7ff00806edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 --2- 172.21.15.114:0/58013499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0240cefc0 0x7ff02415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 >> 172.21.15.114:0/58013499 conn(0x7ff0240b27b0 msgr2=0x7ff0240b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 shutdown_connections 2024-04-13T02:44:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.873+0000 7ff02c755640 1 -- 172.21.15.114:0/58013499 wait complete. 2024-04-13T02:44:42.885 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-13T02:44:42.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:44:42.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.983+0000 7f707adc8640 1 Processor -- start 2024-04-13T02:44:42.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f707adc8640 1 -- start start 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f707adc8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f70740b1200 0x7f70740af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f707adc8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70740af5d0 0x7f707415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f707adc8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b26f0 con 0x7f7074146310 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f707adc8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f70741466f0 con 0x7f70740af5d0 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f707adc8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f70740af9b0 con 0x7f70740b1200 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.984+0000 7f7079365640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70740af5d0 0x7f707415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70740af5d0 0x7f707415d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52664/0 (socket says 172.21.15.114:52664) 2024-04-13T02:44:42.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 -- 172.21.15.114:0/2910212315 learned_addr learned my addr 172.21.15.114:0/2910212315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7073fff640 1 --2- 172.21.15.114:0/2910212315 >> v2:172.21.15.130:3300/0 conn(0x7f70740b1200 0x7f70740af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 -- 172.21.15.114:0/2910212315 >> v2:172.21.15.130:3300/0 conn(0x7f70740b1200 msgr2=0x7f70740af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 --2- 172.21.15.114:0/2910212315 >> v2:172.21.15.130:3300/0 conn(0x7f70740b1200 0x7f70740af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 -- 172.21.15.114:0/2910212315 >> v1:172.21.15.130:6789/0 conn(0x7f7074146310 legacy=0x7f70740b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 -- 172.21.15.114:0/2910212315 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70740b2970 con 0x7f70740af5d0 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.985+0000 7f7079365640 1 --2- 172.21.15.114:0/2910212315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740af5d0 0x7f707415d4e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7074073790 tx=0x7f706c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd2d9415a23167e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f70737fe640 1 -- 172.21.15.114:0/2910212315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c02cb20 con 0x7f70740af5d0 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f70737fe640 1 -- 172.21.15.114:0/2910212315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c02ccc0 con 0x7f70740af5d0 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f70737fe640 1 -- 172.21.15.114:0/2910212315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c034610 con 0x7f70740af5d0 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 -- 172.21.15.114:0/2910212315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740af5d0 msgr2=0x7f707415d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 --2- 172.21.15.114:0/2910212315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740af5d0 0x7f707415d4e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7074073790 tx=0x7f706c02bf80 comp rx=0 tx=0).stop 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 -- 172.21.15.114:0/2910212315 shutdown_connections 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 --2- 172.21.15.114:0/2910212315 >> v2:172.21.15.130:3300/0 conn(0x7f70740b1200 0x7f70740af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 --2- 172.21.15.114:0/2910212315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740af5d0 0x7f707415d4e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 -- 172.21.15.114:0/2910212315 >> 172.21.15.114:0/2910212315 conn(0x7f70740b6f50 msgr2=0x7f707409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:42.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 -- 172.21.15.114:0/2910212315 shutdown_connections 2024-04-13T02:44:42.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.986+0000 7f707adc8640 1 -- 172.21.15.114:0/2910212315 wait complete. 2024-04-13T02:44:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.987+0000 7f707adc8640 1 Processor -- start 2024-04-13T02:44:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.987+0000 7f707adc8640 1 -- start start 2024-04-13T02:44:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f707adc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af5d0 0x7f7074140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f707adc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 0x7f70741f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f707adc8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7074146310 0x7f707413cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f707adc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70740b3210 con 0x7f70740b1200 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f707adc8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70740b2f30 con 0x7f7074146310 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f707adc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f707415cf10 con 0x7f70740af5d0 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f7073fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 0x7f70741f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f7073fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 0x7f70741f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52666/0 (socket says 172.21.15.114:52666) 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f7073fff640 1 -- 172.21.15.114:0/1041495178 learned_addr learned my addr 172.21.15.114:0/1041495178 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f7078b64640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af5d0 0x7f7074140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.988+0000 7f7079365640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7074146310 0x7f707413cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f7073fff640 1 -- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af5d0 msgr2=0x7f7074140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f7073fff640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af5d0 0x7f7074140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f7073fff640 1 -- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7074146310 msgr2=0x7f707413cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f7073fff640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7074146310 0x7f707413cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f7073fff640 1 -- 172.21.15.114:0/1041495178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7074142e40 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f7073fff640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 0x7f70741f21c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f706800d800 tx=0x7f706800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706800b6c0 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7068019070 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7074143120 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706800ba80 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.989+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70741f2700 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.990+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7074068c80 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.990+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f706800bc20 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.991+0000 7f70717fa640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f706006c8f0 0x7f706006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.991+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f706808be40 con 0x7f70740b1200 2024-04-13T02:44:42.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.991+0000 7f7078b64640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f706006c8f0 0x7f706006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:42.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.991+0000 7f7078b64640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f706006c8f0 0x7f706006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7064001780 tx=0x7f7064009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:42.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:42.995+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7068059cb0 con 0x7f70740b1200 2024-04-13T02:44:43.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.167+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7074070ad0 con 0x7f706006c8f0 2024-04-13T02:44:43.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.172+0000 7f70717fa640 1 -- 172.21.15.114:0/1041495178 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f7074070ad0 con 0x7f706006c8f0 2024-04-13T02:44:43.176 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:43.177 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f706006c8f0 msgr2=0x7f706006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f706006c8f0 0x7f706006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7064001780 tx=0x7f7064009040 comp rx=0 tx=0).stop 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 msgr2=0x7f70741f21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 0x7f70741f21c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f706800d800 tx=0x7f706800dcc0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 shutdown_connections 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7074146310 0x7f707413cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70740b1200 0x7f70741f21c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f706006c8f0 0x7f706006edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 --2- 172.21.15.114:0/1041495178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af5d0 0x7f7074140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 >> 172.21.15.114:0/1041495178 conn(0x7f70740b6f50 msgr2=0x7f7074143ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 shutdown_connections 2024-04-13T02:44:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.175+0000 7f707adc8640 1 -- 172.21.15.114:0/1041495178 wait complete. 2024-04-13T02:44:43.187 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-13T02:44:41.487569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219812,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754908,"statfs":{"total":773094113280,"available":772869025792,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000538"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-13T02:44:29.611172+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:44:29.611172+0000","last_peered":"2024-04-13T02:44:29.611172+0000","last_clean":"2024-04-13T02:44:29.611172+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:44:29.611172+0000","last_undegraded":"2024-04-13T02:44:29.611172+0000","last_fullsized":"2024-04-13T02:44:29.611172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:39.198501+0000","last_change":"2024-04-13T02:44:39.198501+0000","last_active":"2024-04-13T02:44:39.198501+0000","last_peered":"2024-04-13T02:44:39.198501+0000","last_clean":"2024-04-13T02:44:39.198501+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:39.198501+0000","last_undegraded":"2024-04-13T02:44:39.198501+0000","last_fullsized":"2024-04-13T02:44:39.198501+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-13T02:44:38.194507+0000","last_change":"2024-04-13T02:44:38.194507+0000","last_active":"2024-04-13T02:44:38.194507+0000","last_peered":"2024-04-13T02:44:38.194507+0000","last_clean":"2024-04-13T02:44:38.194507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:44:38.194507+0000","last_undegraded":"2024-04-13T02:44:38.194507+0000","last_fullsized":"2024-04-13T02:44:38.194507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:44:43.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:44:43.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.326+0000 7f45ac6de640 1 Processor -- start 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.326+0000 7f45ac6de640 1 -- start start 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.327+0000 7f45ac6de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45a415caa0 0x7f45a40d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.327+0000 7f45ac6de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f45a40b3580 0x7f45a40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.327+0000 7f45ac6de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a406c4e0 con 0x7f45a40ae4f0 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.327+0000 7f45ac6de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f45a406c7c0 con 0x7f45a415caa0 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.327+0000 7f45ac6de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f45a406caa0 con 0x7f45a40b3580 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45a415caa0 0x7f45a40d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45a415caa0 0x7f45a40d0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52672/0 (socket says 172.21.15.114:52672) 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 -- 172.21.15.114:0/410526915 learned_addr learned my addr 172.21.15.114:0/410526915 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 -- 172.21.15.114:0/410526915 >> v2:172.21.15.130:3300/0 conn(0x7f45a40b3580 msgr2=0x7f45a40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 --2- 172.21.15.114:0/410526915 >> v2:172.21.15.130:3300/0 conn(0x7f45a40b3580 0x7f45a40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 -- 172.21.15.114:0/410526915 >> v1:172.21.15.130:6789/0 conn(0x7f45a40ae4f0 legacy=0x7f45a40b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:43.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.328+0000 7f45aa47a640 1 -- 172.21.15.114:0/410526915 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a415ce80 con 0x7f45a415caa0 2024-04-13T02:44:43.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45aa47a640 1 --2- 172.21.15.114:0/410526915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a415caa0 0x7f45a40d0bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f459c009e50 tx=0x7f459c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499c688b50b6ab48 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:43.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45a9478640 1 -- 172.21.15.114:0/410526915 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c02ca80 con 0x7f45a415caa0 2024-04-13T02:44:43.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45a9478640 1 -- 172.21.15.114:0/410526915 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c02cc20 con 0x7f45a415caa0 2024-04-13T02:44:43.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45a9478640 1 -- 172.21.15.114:0/410526915 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c0343f0 con 0x7f45a415caa0 2024-04-13T02:44:43.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 -- 172.21.15.114:0/410526915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a415caa0 msgr2=0x7f45a40d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 --2- 172.21.15.114:0/410526915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a415caa0 0x7f45a40d0bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f459c009e50 tx=0x7f459c02bee0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 -- 172.21.15.114:0/410526915 shutdown_connections 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 --2- 172.21.15.114:0/410526915 >> v2:172.21.15.130:3300/0 conn(0x7f45a40b3580 0x7f45a40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 --2- 172.21.15.114:0/410526915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a415caa0 0x7f45a40d0bf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 -- 172.21.15.114:0/410526915 >> 172.21.15.114:0/410526915 conn(0x7f45a40b6700 msgr2=0x7f45a40b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 -- 172.21.15.114:0/410526915 shutdown_connections 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.329+0000 7f45ac6de640 1 -- 172.21.15.114:0/410526915 wait complete. 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 Processor -- start 2024-04-13T02:44:43.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 -- start start 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a40ae4f0 0x7f45a4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 0x7f45a409dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a415caa0 0x7f45a41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4067a50 con 0x7f45a40b3580 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40678d0 con 0x7f45a40ae4f0 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45ac6de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40ce8e0 con 0x7f45a415caa0 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45a9c79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 0x7f45a409dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45a9c79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 0x7f45a409dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52680/0 (socket says 172.21.15.114:52680) 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.331+0000 7f45a9c79640 1 -- 172.21.15.114:0/2935819263 learned_addr learned my addr 172.21.15.114:0/2935819263 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a9c79640 1 -- 172.21.15.114:0/2935819263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a415caa0 msgr2=0x7f45a41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a9c79640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a415caa0 0x7f45a41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a9c79640 1 -- 172.21.15.114:0/2935819263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a40ae4f0 msgr2=0x7f45a4158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a9c79640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a40ae4f0 0x7f45a4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a9c79640 1 -- 172.21.15.114:0/2935819263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4157b30 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a9c79640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 0x7f45a409dcb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f459800c430 tx=0x7f459800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598011790 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598017070 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a4157e10 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598011bb0 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.332+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a41583d0 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.333+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a4068c80 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.333+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f459801c460 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.334+0000 7f45a2ffd640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f459006c8f0 0x7f459006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.334+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f459808ba70 con 0x7f45a40b3580 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.334+0000 7f45aa47a640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f459006c8f0 0x7f459006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.334+0000 7f45aa47a640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f459006c8f0 0x7f459006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f459c035000 tx=0x7f459c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:43.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.338+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4598059ea0 con 0x7f45a40b3580 2024-04-13T02:44:43.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.509+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45a4159ce0 con 0x7f459006c8f0 2024-04-13T02:44:43.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.514+0000 7f45a2ffd640 1 -- 172.21.15.114:0/2935819263 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f45a4159ce0 con 0x7f459006c8f0 2024-04-13T02:44:43.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:43.519 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.517+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f459006c8f0 msgr2=0x7f459006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.517+0000 7f45ac6de640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f459006c8f0 0x7f459006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f459c035000 tx=0x7f459c02e000 comp rx=0 tx=0).stop 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.517+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 msgr2=0x7f45a409dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.517+0000 7f45ac6de640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 0x7f45a409dcb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f459800c430 tx=0x7f459800c8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.517+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 shutdown_connections 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f459006c8f0 0x7f459006edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a415caa0 0x7f45a41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40b3580 0x7f45a409dcb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 --2- 172.21.15.114:0/2935819263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a40ae4f0 0x7f45a4158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 >> 172.21.15.114:0/2935819263 conn(0x7f45a40b6700 msgr2=0x7f45a406b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 shutdown_connections 2024-04-13T02:44:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.518+0000 7f45ac6de640 1 -- 172.21.15.114:0/2935819263 wait complete. 2024-04-13T02:44:43.529 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-13T02:44:43.487850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.286302"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229767+0000","last_change":"2024-04-13T02:44:40.230633+0000","last_active":"2024-04-13T02:44:41.229767+0000","last_peered":"2024-04-13T02:44:41.229767+0000","last_clean":"2024-04-13T02:44:41.229767+0000","last_became_active":"2024-04-13T02:44:40.229553+0000","last_became_peered":"2024-04-13T02:44:40.229553+0000","last_unstale":"2024-04-13T02:44:41.229767+0000","last_undegraded":"2024-04-13T02:44:41.229767+0000","last_fullsized":"2024-04-13T02:44:41.229767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:17:28.338011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223475+0000","last_change":"2024-04-13T02:44:40.222537+0000","last_active":"2024-04-13T02:44:41.223475+0000","last_peered":"2024-04-13T02:44:41.223475+0000","last_clean":"2024-04-13T02:44:41.223475+0000","last_became_active":"2024-04-13T02:44:40.222285+0000","last_became_peered":"2024-04-13T02:44:40.222285+0000","last_unstale":"2024-04-13T02:44:41.223475+0000","last_undegraded":"2024-04-13T02:44:41.223475+0000","last_fullsized":"2024-04-13T02:44:41.223475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286895+0000","last_change":"2024-04-13T02:44:40.224528+0000","last_active":"2024-04-13T02:44:41.286895+0000","last_peered":"2024-04-13T02:44:41.286895+0000","last_clean":"2024-04-13T02:44:41.286895+0000","last_became_active":"2024-04-13T02:44:40.224212+0000","last_became_peered":"2024-04-13T02:44:40.224212+0000","last_unstale":"2024-04-13T02:44:41.286895+0000","last_undegraded":"2024-04-13T02:44:41.286895+0000","last_fullsized":"2024-04-13T02:44:41.286895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286877+0000","last_change":"2024-04-13T02:44:40.236982+0000","last_active":"2024-04-13T02:44:41.286877+0000","last_peered":"2024-04-13T02:44:41.286877+0000","last_clean":"2024-04-13T02:44:41.286877+0000","last_became_active":"2024-04-13T02:44:40.236331+0000","last_became_peered":"2024-04-13T02:44:40.236331+0000","last_unstale":"2024-04-13T02:44:41.286877+0000","last_undegraded":"2024-04-13T02:44:41.286877+0000","last_fullsized":"2024-04-13T02:44:41.286877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230228+0000","last_change":"2024-04-13T02:44:40.219544+0000","last_active":"2024-04-13T02:44:41.230228+0000","last_peered":"2024-04-13T02:44:41.230228+0000","last_clean":"2024-04-13T02:44:41.230228+0000","last_became_active":"2024-04-13T02:44:40.219255+0000","last_became_peered":"2024-04-13T02:44:40.219255+0000","last_unstale":"2024-04-13T02:44:41.230228+0000","last_undegraded":"2024-04-13T02:44:41.230228+0000","last_fullsized":"2024-04-13T02:44:41.230228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:56:10.757469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286700+0000","last_change":"2024-04-13T02:44:40.238704+0000","last_active":"2024-04-13T02:44:41.286700+0000","last_peered":"2024-04-13T02:44:41.286700+0000","last_clean":"2024-04-13T02:44:41.286700+0000","last_became_active":"2024-04-13T02:44:40.238452+0000","last_became_peered":"2024-04-13T02:44:40.238452+0000","last_unstale":"2024-04-13T02:44:41.286700+0000","last_undegraded":"2024-04-13T02:44:41.286700+0000","last_fullsized":"2024-04-13T02:44:41.286700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229704+0000","last_change":"2024-04-13T02:44:40.226014+0000","last_active":"2024-04-13T02:44:41.229704+0000","last_peered":"2024-04-13T02:44:41.229704+0000","last_clean":"2024-04-13T02:44:41.229704+0000","last_became_active":"2024-04-13T02:44:40.223159+0000","last_became_peered":"2024-04-13T02:44:40.223159+0000","last_unstale":"2024-04-13T02:44:41.229704+0000","last_undegraded":"2024-04-13T02:44:41.229704+0000","last_fullsized":"2024-04-13T02:44:41.229704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:52:45.259162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287186+0000","last_change":"2024-04-13T02:44:40.238313+0000","last_active":"2024-04-13T02:44:41.287186+0000","last_peered":"2024-04-13T02:44:41.287186+0000","last_clean":"2024-04-13T02:44:41.287186+0000","last_became_active":"2024-04-13T02:44:40.238050+0000","last_became_peered":"2024-04-13T02:44:40.238050+0000","last_unstale":"2024-04-13T02:44:41.287186+0000","last_undegraded":"2024-04-13T02:44:41.287186+0000","last_fullsized":"2024-04-13T02:44:41.287186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230173+0000","last_change":"2024-04-13T02:44:40.239316+0000","last_active":"2024-04-13T02:44:41.230173+0000","last_peered":"2024-04-13T02:44:41.230173+0000","last_clean":"2024-04-13T02:44:41.230173+0000","last_became_active":"2024-04-13T02:44:40.238176+0000","last_became_peered":"2024-04-13T02:44:40.238176+0000","last_unstale":"2024-04-13T02:44:41.230173+0000","last_undegraded":"2024-04-13T02:44:41.230173+0000","last_fullsized":"2024-04-13T02:44:41.230173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:30:16.725686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230294+0000","last_change":"2024-04-13T02:44:40.237209+0000","last_active":"2024-04-13T02:44:41.230294+0000","last_peered":"2024-04-13T02:44:41.230294+0000","last_clean":"2024-04-13T02:44:41.230294+0000","last_became_active":"2024-04-13T02:44:40.236901+0000","last_became_peered":"2024-04-13T02:44:40.236901+0000","last_unstale":"2024-04-13T02:44:41.230294+0000","last_undegraded":"2024-04-13T02:44:41.230294+0000","last_fullsized":"2024-04-13T02:44:41.230294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229417+0000","last_change":"2024-04-13T02:44:40.237664+0000","last_active":"2024-04-13T02:44:41.229417+0000","last_peered":"2024-04-13T02:44:41.229417+0000","last_clean":"2024-04-13T02:44:41.229417+0000","last_became_active":"2024-04-13T02:44:40.237363+0000","last_became_peered":"2024-04-13T02:44:40.237363+0000","last_unstale":"2024-04-13T02:44:41.229417+0000","last_undegraded":"2024-04-13T02:44:41.229417+0000","last_fullsized":"2024-04-13T02:44:41.229417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231205+0000","last_change":"2024-04-13T02:44:40.225679+0000","last_active":"2024-04-13T02:44:41.231205+0000","last_peered":"2024-04-13T02:44:41.231205+0000","last_clean":"2024-04-13T02:44:41.231205+0000","last_became_active":"2024-04-13T02:44:40.225402+0000","last_became_peered":"2024-04-13T02:44:40.225402+0000","last_unstale":"2024-04-13T02:44:41.231205+0000","last_undegraded":"2024-04-13T02:44:41.231205+0000","last_fullsized":"2024-04-13T02:44:41.231205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:30.234347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287653+0000","last_change":"2024-04-13T02:44:40.226365+0000","last_active":"2024-04-13T02:44:41.287653+0000","last_peered":"2024-04-13T02:44:41.287653+0000","last_clean":"2024-04-13T02:44:41.287653+0000","last_became_active":"2024-04-13T02:44:40.226103+0000","last_became_peered":"2024-04-13T02:44:40.226103+0000","last_unstale":"2024-04-13T02:44:41.287653+0000","last_undegraded":"2024-04-13T02:44:41.287653+0000","last_fullsized":"2024-04-13T02:44:41.287653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286468+0000","last_change":"2024-04-13T02:44:40.228743+0000","last_active":"2024-04-13T02:44:41.286468+0000","last_peered":"2024-04-13T02:44:41.286468+0000","last_clean":"2024-04-13T02:44:41.286468+0000","last_became_active":"2024-04-13T02:44:40.228492+0000","last_became_peered":"2024-04-13T02:44:40.228492+0000","last_unstale":"2024-04-13T02:44:41.286468+0000","last_undegraded":"2024-04-13T02:44:41.286468+0000","last_fullsized":"2024-04-13T02:44:41.286468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:08:04.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223149+0000","last_change":"2024-04-13T02:44:40.225456+0000","last_active":"2024-04-13T02:44:41.223149+0000","last_peered":"2024-04-13T02:44:41.223149+0000","last_clean":"2024-04-13T02:44:41.223149+0000","last_became_active":"2024-04-13T02:44:40.225188+0000","last_became_peered":"2024-04-13T02:44:40.225188+0000","last_unstale":"2024-04-13T02:44:41.223149+0000","last_undegraded":"2024-04-13T02:44:41.223149+0000","last_fullsized":"2024-04-13T02:44:41.223149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286591+0000","last_change":"2024-04-13T02:44:40.237710+0000","last_active":"2024-04-13T02:44:41.286591+0000","last_peered":"2024-04-13T02:44:41.286591+0000","last_clean":"2024-04-13T02:44:41.286591+0000","last_became_active":"2024-04-13T02:44:40.237420+0000","last_became_peered":"2024-04-13T02:44:40.237420+0000","last_unstale":"2024-04-13T02:44:41.286591+0000","last_undegraded":"2024-04-13T02:44:41.286591+0000","last_fullsized":"2024-04-13T02:44:41.286591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287251+0000","last_change":"2024-04-13T02:44:40.236472+0000","last_active":"2024-04-13T02:44:41.287251+0000","last_peered":"2024-04-13T02:44:41.287251+0000","last_clean":"2024-04-13T02:44:41.287251+0000","last_became_active":"2024-04-13T02:44:40.236012+0000","last_became_peered":"2024-04-13T02:44:40.236012+0000","last_unstale":"2024-04-13T02:44:41.287251+0000","last_undegraded":"2024-04-13T02:44:41.287251+0000","last_fullsized":"2024-04-13T02:44:41.287251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:17:28.338011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286361+0000","last_change":"2024-04-13T02:44:40.224907+0000","last_active":"2024-04-13T02:44:41.286361+0000","last_peered":"2024-04-13T02:44:41.286361+0000","last_clean":"2024-04-13T02:44:41.286361+0000","last_became_active":"2024-04-13T02:44:40.224661+0000","last_became_peered":"2024-04-13T02:44:40.224661+0000","last_unstale":"2024-04-13T02:44:41.286361+0000","last_undegraded":"2024-04-13T02:44:41.286361+0000","last_fullsized":"2024-04-13T02:44:41.286361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:30.234347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229562+0000","last_change":"2024-04-13T02:44:40.227792+0000","last_active":"2024-04-13T02:44:41.229562+0000","last_peered":"2024-04-13T02:44:41.229562+0000","last_clean":"2024-04-13T02:44:41.229562+0000","last_became_active":"2024-04-13T02:44:40.227476+0000","last_became_peered":"2024-04-13T02:44:40.227476+0000","last_unstale":"2024-04-13T02:44:41.229562+0000","last_undegraded":"2024-04-13T02:44:41.229562+0000","last_fullsized":"2024-04-13T02:44:41.229562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:05.949674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228987+0000","last_change":"2024-04-13T02:44:40.227430+0000","last_active":"2024-04-13T02:44:41.228987+0000","last_peered":"2024-04-13T02:44:41.228987+0000","last_clean":"2024-04-13T02:44:41.228987+0000","last_became_active":"2024-04-13T02:44:40.226916+0000","last_became_peered":"2024-04-13T02:44:40.226916+0000","last_unstale":"2024-04-13T02:44:41.228987+0000","last_undegraded":"2024-04-13T02:44:41.228987+0000","last_fullsized":"2024-04-13T02:44:41.228987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286873+0000","last_change":"2024-04-13T02:44:40.229586+0000","last_active":"2024-04-13T02:44:41.286873+0000","last_peered":"2024-04-13T02:44:41.286873+0000","last_clean":"2024-04-13T02:44:41.286873+0000","last_became_active":"2024-04-13T02:44:40.229314+0000","last_became_peered":"2024-04-13T02:44:40.229314+0000","last_unstale":"2024-04-13T02:44:41.286873+0000","last_undegraded":"2024-04-13T02:44:41.286873+0000","last_fullsized":"2024-04-13T02:44:41.286873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:43:21.359238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286802+0000","last_change":"2024-04-13T02:44:40.241419+0000","last_active":"2024-04-13T02:44:41.286802+0000","last_peered":"2024-04-13T02:44:41.286802+0000","last_clean":"2024-04-13T02:44:41.286802+0000","last_became_active":"2024-04-13T02:44:40.241126+0000","last_became_peered":"2024-04-13T02:44:40.241126+0000","last_unstale":"2024-04-13T02:44:41.286802+0000","last_undegraded":"2024-04-13T02:44:41.286802+0000","last_fullsized":"2024-04-13T02:44:41.286802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:28:51.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287333+0000","last_change":"2024-04-13T02:44:40.231595+0000","last_active":"2024-04-13T02:44:41.287333+0000","last_peered":"2024-04-13T02:44:41.287333+0000","last_clean":"2024-04-13T02:44:41.287333+0000","last_became_active":"2024-04-13T02:44:40.231324+0000","last_became_peered":"2024-04-13T02:44:40.231324+0000","last_unstale":"2024-04-13T02:44:41.287333+0000","last_undegraded":"2024-04-13T02:44:41.287333+0000","last_fullsized":"2024-04-13T02:44:41.287333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286891+0000","last_change":"2024-04-13T02:44:40.233812+0000","last_active":"2024-04-13T02:44:41.286891+0000","last_peered":"2024-04-13T02:44:41.286891+0000","last_clean":"2024-04-13T02:44:41.286891+0000","last_became_active":"2024-04-13T02:44:40.233554+0000","last_became_peered":"2024-04-13T02:44:40.233554+0000","last_unstale":"2024-04-13T02:44:41.286891+0000","last_undegraded":"2024-04-13T02:44:41.286891+0000","last_fullsized":"2024-04-13T02:44:41.286891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:22:29.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287934+0000","last_change":"2024-04-13T02:44:40.227589+0000","last_active":"2024-04-13T02:44:41.287934+0000","last_peered":"2024-04-13T02:44:41.287934+0000","last_clean":"2024-04-13T02:44:41.287934+0000","last_became_active":"2024-04-13T02:44:40.227296+0000","last_became_peered":"2024-04-13T02:44:40.227296+0000","last_unstale":"2024-04-13T02:44:41.287934+0000","last_undegraded":"2024-04-13T02:44:41.287934+0000","last_fullsized":"2024-04-13T02:44:41.287934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230427+0000","last_change":"2024-04-13T02:44:40.230572+0000","last_active":"2024-04-13T02:44:41.230427+0000","last_peered":"2024-04-13T02:44:41.230427+0000","last_clean":"2024-04-13T02:44:41.230427+0000","last_became_active":"2024-04-13T02:44:40.230294+0000","last_became_peered":"2024-04-13T02:44:40.230294+0000","last_unstale":"2024-04-13T02:44:41.230427+0000","last_undegraded":"2024-04-13T02:44:41.230427+0000","last_fullsized":"2024-04-13T02:44:41.230427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223241+0000","last_change":"2024-04-13T02:44:40.225831+0000","last_active":"2024-04-13T02:44:41.223241+0000","last_peered":"2024-04-13T02:44:41.223241+0000","last_clean":"2024-04-13T02:44:41.223241+0000","last_became_active":"2024-04-13T02:44:40.225519+0000","last_became_peered":"2024-04-13T02:44:40.225519+0000","last_unstale":"2024-04-13T02:44:41.223241+0000","last_undegraded":"2024-04-13T02:44:41.223241+0000","last_fullsized":"2024-04-13T02:44:41.223241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287503+0000","last_change":"2024-04-13T02:44:40.231590+0000","last_active":"2024-04-13T02:44:41.287503+0000","last_peered":"2024-04-13T02:44:41.287503+0000","last_clean":"2024-04-13T02:44:41.287503+0000","last_became_active":"2024-04-13T02:44:40.231334+0000","last_became_peered":"2024-04-13T02:44:40.231334+0000","last_unstale":"2024-04-13T02:44:41.287503+0000","last_undegraded":"2024-04-13T02:44:41.287503+0000","last_fullsized":"2024-04-13T02:44:41.287503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286995+0000","last_change":"2024-04-13T02:44:40.227342+0000","last_active":"2024-04-13T02:44:41.286995+0000","last_peered":"2024-04-13T02:44:41.286995+0000","last_clean":"2024-04-13T02:44:41.286995+0000","last_became_active":"2024-04-13T02:44:40.227062+0000","last_became_peered":"2024-04-13T02:44:40.227062+0000","last_unstale":"2024-04-13T02:44:41.286995+0000","last_undegraded":"2024-04-13T02:44:41.286995+0000","last_fullsized":"2024-04-13T02:44:41.286995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287004+0000","last_change":"2024-04-13T02:44:40.232709+0000","last_active":"2024-04-13T02:44:41.287004+0000","last_peered":"2024-04-13T02:44:41.287004+0000","last_clean":"2024-04-13T02:44:41.287004+0000","last_became_active":"2024-04-13T02:44:40.232444+0000","last_became_peered":"2024-04-13T02:44:40.232444+0000","last_unstale":"2024-04-13T02:44:41.287004+0000","last_undegraded":"2024-04-13T02:44:41.287004+0000","last_fullsized":"2024-04-13T02:44:41.287004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:05.949674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286710+0000","last_change":"2024-04-13T02:44:40.239126+0000","last_active":"2024-04-13T02:44:41.286710+0000","last_peered":"2024-04-13T02:44:41.286710+0000","last_clean":"2024-04-13T02:44:41.286710+0000","last_became_active":"2024-04-13T02:44:40.238820+0000","last_became_peered":"2024-04-13T02:44:40.238820+0000","last_unstale":"2024-04-13T02:44:41.286710+0000","last_undegraded":"2024-04-13T02:44:41.286710+0000","last_fullsized":"2024-04-13T02:44:41.286710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:24.204040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228646+0000","last_change":"2024-04-13T02:44:40.225771+0000","last_active":"2024-04-13T02:44:41.228646+0000","last_peered":"2024-04-13T02:44:41.228646+0000","last_clean":"2024-04-13T02:44:41.228646+0000","last_became_active":"2024-04-13T02:44:40.225482+0000","last_became_peered":"2024-04-13T02:44:40.225482+0000","last_unstale":"2024-04-13T02:44:41.228646+0000","last_undegraded":"2024-04-13T02:44:41.228646+0000","last_fullsized":"2024-04-13T02:44:41.228646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:43:21.359238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231043+0000","last_change":"2024-04-13T02:44:40.228987+0000","last_active":"2024-04-13T02:44:41.231043+0000","last_peered":"2024-04-13T02:44:41.231043+0000","last_clean":"2024-04-13T02:44:41.231043+0000","last_became_active":"2024-04-13T02:44:40.228645+0000","last_became_peered":"2024-04-13T02:44:40.228645+0000","last_unstale":"2024-04-13T02:44:41.231043+0000","last_undegraded":"2024-04-13T02:44:41.231043+0000","last_fullsized":"2024-04-13T02:44:41.231043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:53.107374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287771+0000","last_change":"2024-04-13T02:44:39.214920+0000","last_active":"2024-04-13T02:44:41.287771+0000","last_peered":"2024-04-13T02:44:41.287771+0000","last_clean":"2024-04-13T02:44:41.287771+0000","last_became_active":"2024-04-13T02:44:39.213481+0000","last_became_peered":"2024-04-13T02:44:39.213481+0000","last_unstale":"2024-04-13T02:44:41.287771+0000","last_undegraded":"2024-04-13T02:44:41.287771+0000","last_fullsized":"2024-04-13T02:44:41.287771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287017+0000","last_change":"2024-04-13T02:44:40.227426+0000","last_active":"2024-04-13T02:44:41.287017+0000","last_peered":"2024-04-13T02:44:41.287017+0000","last_clean":"2024-04-13T02:44:41.287017+0000","last_became_active":"2024-04-13T02:44:40.226865+0000","last_became_peered":"2024-04-13T02:44:40.226865+0000","last_unstale":"2024-04-13T02:44:41.287017+0000","last_undegraded":"2024-04-13T02:44:41.287017+0000","last_fullsized":"2024-04-13T02:44:41.287017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228853+0000","last_change":"2024-04-13T02:44:39.216952+0000","last_active":"2024-04-13T02:44:41.228853+0000","last_peered":"2024-04-13T02:44:41.228853+0000","last_clean":"2024-04-13T02:44:41.228853+0000","last_became_active":"2024-04-13T02:44:39.216642+0000","last_became_peered":"2024-04-13T02:44:39.216642+0000","last_unstale":"2024-04-13T02:44:41.228853+0000","last_undegraded":"2024-04-13T02:44:41.228853+0000","last_fullsized":"2024-04-13T02:44:41.228853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287286+0000","last_change":"2024-04-13T02:44:39.215674+0000","last_active":"2024-04-13T02:44:41.287286+0000","last_peered":"2024-04-13T02:44:41.287286+0000","last_clean":"2024-04-13T02:44:41.287286+0000","last_became_active":"2024-04-13T02:44:39.215390+0000","last_became_peered":"2024-04-13T02:44:39.215390+0000","last_unstale":"2024-04-13T02:44:41.287286+0000","last_undegraded":"2024-04-13T02:44:41.287286+0000","last_fullsized":"2024-04-13T02:44:41.287286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287324+0000","last_change":"2024-04-13T02:44:40.224744+0000","last_active":"2024-04-13T02:44:41.287324+0000","last_peered":"2024-04-13T02:44:41.287324+0000","last_clean":"2024-04-13T02:44:41.287324+0000","last_became_active":"2024-04-13T02:44:40.224408+0000","last_became_peered":"2024-04-13T02:44:40.224408+0000","last_unstale":"2024-04-13T02:44:41.287324+0000","last_undegraded":"2024-04-13T02:44:41.287324+0000","last_fullsized":"2024-04-13T02:44:41.287324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286792+0000","last_change":"2024-04-13T02:44:39.222541+0000","last_active":"2024-04-13T02:44:41.286792+0000","last_peered":"2024-04-13T02:44:41.286792+0000","last_clean":"2024-04-13T02:44:41.286792+0000","last_became_active":"2024-04-13T02:44:39.222178+0000","last_became_peered":"2024-04-13T02:44:39.222178+0000","last_unstale":"2024-04-13T02:44:41.286792+0000","last_undegraded":"2024-04-13T02:44:41.286792+0000","last_fullsized":"2024-04-13T02:44:41.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223143+0000","last_change":"2024-04-13T02:44:40.229697+0000","last_active":"2024-04-13T02:44:41.223143+0000","last_peered":"2024-04-13T02:44:41.223143+0000","last_clean":"2024-04-13T02:44:41.223143+0000","last_became_active":"2024-04-13T02:44:40.228188+0000","last_became_peered":"2024-04-13T02:44:40.228188+0000","last_unstale":"2024-04-13T02:44:41.223143+0000","last_undegraded":"2024-04-13T02:44:41.223143+0000","last_fullsized":"2024-04-13T02:44:41.223143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229958+0000","last_change":"2024-04-13T02:44:39.224508+0000","last_active":"2024-04-13T02:44:41.229958+0000","last_peered":"2024-04-13T02:44:41.229958+0000","last_clean":"2024-04-13T02:44:41.229958+0000","last_became_active":"2024-04-13T02:44:39.224118+0000","last_became_peered":"2024-04-13T02:44:39.224118+0000","last_unstale":"2024-04-13T02:44:41.229958+0000","last_undegraded":"2024-04-13T02:44:41.229958+0000","last_fullsized":"2024-04-13T02:44:41.229958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287025+0000","last_change":"2024-04-13T02:44:40.232833+0000","last_active":"2024-04-13T02:44:41.287025+0000","last_peered":"2024-04-13T02:44:41.287025+0000","last_clean":"2024-04-13T02:44:41.287025+0000","last_became_active":"2024-04-13T02:44:40.232554+0000","last_became_peered":"2024-04-13T02:44:40.232554+0000","last_unstale":"2024-04-13T02:44:41.287025+0000","last_undegraded":"2024-04-13T02:44:41.287025+0000","last_fullsized":"2024-04-13T02:44:41.287025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:52:45.259162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286911+0000","last_change":"2024-04-13T02:44:39.223166+0000","last_active":"2024-04-13T02:44:41.286911+0000","last_peered":"2024-04-13T02:44:41.286911+0000","last_clean":"2024-04-13T02:44:41.286911+0000","last_became_active":"2024-04-13T02:44:39.222884+0000","last_became_peered":"2024-04-13T02:44:39.222884+0000","last_unstale":"2024-04-13T02:44:41.286911+0000","last_undegraded":"2024-04-13T02:44:41.286911+0000","last_fullsized":"2024-04-13T02:44:41.286911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287061+0000","last_change":"2024-04-13T02:44:40.237654+0000","last_active":"2024-04-13T02:44:41.287061+0000","last_peered":"2024-04-13T02:44:41.287061+0000","last_clean":"2024-04-13T02:44:41.287061+0000","last_became_active":"2024-04-13T02:44:40.237119+0000","last_became_peered":"2024-04-13T02:44:40.237119+0000","last_unstale":"2024-04-13T02:44:41.287061+0000","last_undegraded":"2024-04-13T02:44:41.287061+0000","last_fullsized":"2024-04-13T02:44:41.287061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223435+0000","last_change":"2024-04-13T02:44:39.221993+0000","last_active":"2024-04-13T02:44:41.223435+0000","last_peered":"2024-04-13T02:44:41.223435+0000","last_clean":"2024-04-13T02:44:41.223435+0000","last_became_active":"2024-04-13T02:44:39.221682+0000","last_became_peered":"2024-04-13T02:44:39.221682+0000","last_unstale":"2024-04-13T02:44:41.223435+0000","last_undegraded":"2024-04-13T02:44:41.223435+0000","last_fullsized":"2024-04-13T02:44:41.223435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:29.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231233+0000","last_change":"2024-04-13T02:44:40.229580+0000","last_active":"2024-04-13T02:44:41.231233+0000","last_peered":"2024-04-13T02:44:41.231233+0000","last_clean":"2024-04-13T02:44:41.231233+0000","last_became_active":"2024-04-13T02:44:40.229234+0000","last_became_peered":"2024-04-13T02:44:40.229234+0000","last_unstale":"2024-04-13T02:44:41.231233+0000","last_undegraded":"2024-04-13T02:44:41.231233+0000","last_fullsized":"2024-04-13T02:44:41.231233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:24.204040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229184+0000","last_change":"2024-04-13T02:44:39.220422+0000","last_active":"2024-04-13T02:44:41.229184+0000","last_peered":"2024-04-13T02:44:41.229184+0000","last_clean":"2024-04-13T02:44:41.229184+0000","last_became_active":"2024-04-13T02:44:39.220071+0000","last_became_peered":"2024-04-13T02:44:39.220071+0000","last_unstale":"2024-04-13T02:44:41.229184+0000","last_undegraded":"2024-04-13T02:44:41.229184+0000","last_fullsized":"2024-04-13T02:44:41.229184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229245+0000","last_change":"2024-04-13T02:44:40.226890+0000","last_active":"2024-04-13T02:44:41.229245+0000","last_peered":"2024-04-13T02:44:41.229245+0000","last_clean":"2024-04-13T02:44:41.229245+0000","last_became_active":"2024-04-13T02:44:40.224137+0000","last_became_peered":"2024-04-13T02:44:40.224137+0000","last_unstale":"2024-04-13T02:44:41.229245+0000","last_undegraded":"2024-04-13T02:44:41.229245+0000","last_fullsized":"2024-04-13T02:44:41.229245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287114+0000","last_change":"2024-04-13T02:44:39.215405+0000","last_active":"2024-04-13T02:44:41.287114+0000","last_peered":"2024-04-13T02:44:41.287114+0000","last_clean":"2024-04-13T02:44:41.287114+0000","last_became_active":"2024-04-13T02:44:39.215134+0000","last_became_peered":"2024-04-13T02:44:39.215134+0000","last_unstale":"2024-04-13T02:44:41.287114+0000","last_undegraded":"2024-04-13T02:44:41.287114+0000","last_fullsized":"2024-04-13T02:44:41.287114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:01:39.290126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286601+0000","last_change":"2024-04-13T02:44:40.236884+0000","last_active":"2024-04-13T02:44:41.286601+0000","last_peered":"2024-04-13T02:44:41.286601+0000","last_clean":"2024-04-13T02:44:41.286601+0000","last_became_active":"2024-04-13T02:44:40.236622+0000","last_became_peered":"2024-04-13T02:44:40.236622+0000","last_unstale":"2024-04-13T02:44:41.286601+0000","last_undegraded":"2024-04-13T02:44:41.286601+0000","last_fullsized":"2024-04-13T02:44:41.286601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:12:12.862195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286931+0000","last_change":"2024-04-13T02:44:39.222283+0000","last_active":"2024-04-13T02:44:41.286931+0000","last_peered":"2024-04-13T02:44:41.286931+0000","last_clean":"2024-04-13T02:44:41.286931+0000","last_became_active":"2024-04-13T02:44:39.222011+0000","last_became_peered":"2024-04-13T02:44:39.222011+0000","last_unstale":"2024-04-13T02:44:41.286931+0000","last_undegraded":"2024-04-13T02:44:41.286931+0000","last_fullsized":"2024-04-13T02:44:41.286931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230336+0000","last_change":"2024-04-13T02:44:40.226836+0000","last_active":"2024-04-13T02:44:41.230336+0000","last_peered":"2024-04-13T02:44:41.230336+0000","last_clean":"2024-04-13T02:44:41.230336+0000","last_became_active":"2024-04-13T02:44:40.226543+0000","last_became_peered":"2024-04-13T02:44:40.226543+0000","last_unstale":"2024-04-13T02:44:41.230336+0000","last_undegraded":"2024-04-13T02:44:41.230336+0000","last_fullsized":"2024-04-13T02:44:41.230336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:02:38.309228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228786+0000","last_change":"2024-04-13T02:44:39.217101+0000","last_active":"2024-04-13T02:44:41.228786+0000","last_peered":"2024-04-13T02:44:41.228786+0000","last_clean":"2024-04-13T02:44:41.228786+0000","last_became_active":"2024-04-13T02:44:39.216631+0000","last_became_peered":"2024-04-13T02:44:39.216631+0000","last_unstale":"2024-04-13T02:44:41.228786+0000","last_undegraded":"2024-04-13T02:44:41.228786+0000","last_fullsized":"2024-04-13T02:44:41.228786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228647+0000","last_change":"2024-04-13T02:44:40.227724+0000","last_active":"2024-04-13T02:44:41.228647+0000","last_peered":"2024-04-13T02:44:41.228647+0000","last_clean":"2024-04-13T02:44:41.228647+0000","last_became_active":"2024-04-13T02:44:40.226329+0000","last_became_peered":"2024-04-13T02:44:40.226329+0000","last_unstale":"2024-04-13T02:44:41.228647+0000","last_undegraded":"2024-04-13T02:44:41.228647+0000","last_fullsized":"2024-04-13T02:44:41.228647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286319+0000","last_change":"2024-04-13T02:44:39.220470+0000","last_active":"2024-04-13T02:44:41.286319+0000","last_peered":"2024-04-13T02:44:41.286319+0000","last_clean":"2024-04-13T02:44:41.286319+0000","last_became_active":"2024-04-13T02:44:39.220165+0000","last_became_peered":"2024-04-13T02:44:39.220165+0000","last_unstale":"2024-04-13T02:44:41.286319+0000","last_undegraded":"2024-04-13T02:44:41.286319+0000","last_fullsized":"2024-04-13T02:44:41.286319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230076+0000","last_change":"2024-04-13T02:44:40.226549+0000","last_active":"2024-04-13T02:44:41.230076+0000","last_peered":"2024-04-13T02:44:41.230076+0000","last_clean":"2024-04-13T02:44:41.230076+0000","last_became_active":"2024-04-13T02:44:40.223509+0000","last_became_peered":"2024-04-13T02:44:40.223509+0000","last_unstale":"2024-04-13T02:44:41.230076+0000","last_undegraded":"2024-04-13T02:44:41.230076+0000","last_fullsized":"2024-04-13T02:44:41.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:09:46.354760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231188+0000","last_change":"2024-04-13T02:44:39.213369+0000","last_active":"2024-04-13T02:44:41.231188+0000","last_peered":"2024-04-13T02:44:41.231188+0000","last_clean":"2024-04-13T02:44:41.231188+0000","last_became_active":"2024-04-13T02:44:39.213049+0000","last_became_peered":"2024-04-13T02:44:39.213049+0000","last_unstale":"2024-04-13T02:44:41.231188+0000","last_undegraded":"2024-04-13T02:44:41.231188+0000","last_fullsized":"2024-04-13T02:44:41.231188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:29:00.582843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229693+0000","last_change":"2024-04-13T02:44:40.227249+0000","last_active":"2024-04-13T02:44:41.229693+0000","last_peered":"2024-04-13T02:44:41.229693+0000","last_clean":"2024-04-13T02:44:41.229693+0000","last_became_active":"2024-04-13T02:44:40.226935+0000","last_became_peered":"2024-04-13T02:44:40.226935+0000","last_unstale":"2024-04-13T02:44:41.229693+0000","last_undegraded":"2024-04-13T02:44:41.229693+0000","last_fullsized":"2024-04-13T02:44:41.229693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:38:37.826515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286339+0000","last_change":"2024-04-13T02:44:39.219683+0000","last_active":"2024-04-13T02:44:41.286339+0000","last_peered":"2024-04-13T02:44:41.286339+0000","last_clean":"2024-04-13T02:44:41.286339+0000","last_became_active":"2024-04-13T02:44:39.219383+0000","last_became_peered":"2024-04-13T02:44:39.219383+0000","last_unstale":"2024-04-13T02:44:41.286339+0000","last_undegraded":"2024-04-13T02:44:41.286339+0000","last_fullsized":"2024-04-13T02:44:41.286339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230678+0000","last_change":"2024-04-13T02:44:40.229158+0000","last_active":"2024-04-13T02:44:41.230678+0000","last_peered":"2024-04-13T02:44:41.230678+0000","last_clean":"2024-04-13T02:44:41.230678+0000","last_became_active":"2024-04-13T02:44:40.226959+0000","last_became_peered":"2024-04-13T02:44:40.226959+0000","last_unstale":"2024-04-13T02:44:41.230678+0000","last_undegraded":"2024-04-13T02:44:41.230678+0000","last_fullsized":"2024-04-13T02:44:41.230678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:42:12.349502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223394+0000","last_change":"2024-04-13T02:44:39.219002+0000","last_active":"2024-04-13T02:44:41.223394+0000","last_peered":"2024-04-13T02:44:41.223394+0000","last_clean":"2024-04-13T02:44:41.223394+0000","last_became_active":"2024-04-13T02:44:39.218708+0000","last_became_peered":"2024-04-13T02:44:39.218708+0000","last_unstale":"2024-04-13T02:44:41.223394+0000","last_undegraded":"2024-04-13T02:44:41.223394+0000","last_fullsized":"2024-04-13T02:44:41.223394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:23.200046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286950+0000","last_change":"2024-04-13T02:44:40.233452+0000","last_active":"2024-04-13T02:44:41.286950+0000","last_peered":"2024-04-13T02:44:41.286950+0000","last_clean":"2024-04-13T02:44:41.286950+0000","last_became_active":"2024-04-13T02:44:40.233136+0000","last_became_peered":"2024-04-13T02:44:40.233136+0000","last_unstale":"2024-04-13T02:44:41.286950+0000","last_undegraded":"2024-04-13T02:44:41.286950+0000","last_fullsized":"2024-04-13T02:44:41.286950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286687+0000","last_change":"2024-04-13T02:44:39.224219+0000","last_active":"2024-04-13T02:44:41.286687+0000","last_peered":"2024-04-13T02:44:41.286687+0000","last_clean":"2024-04-13T02:44:41.286687+0000","last_became_active":"2024-04-13T02:44:39.223880+0000","last_became_peered":"2024-04-13T02:44:39.223880+0000","last_unstale":"2024-04-13T02:44:41.286687+0000","last_undegraded":"2024-04-13T02:44:41.286687+0000","last_fullsized":"2024-04-13T02:44:41.286687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229315+0000","last_change":"2024-04-13T02:44:40.237388+0000","last_active":"2024-04-13T02:44:41.229315+0000","last_peered":"2024-04-13T02:44:41.229315+0000","last_clean":"2024-04-13T02:44:41.229315+0000","last_became_active":"2024-04-13T02:44:40.237135+0000","last_became_peered":"2024-04-13T02:44:40.237135+0000","last_unstale":"2024-04-13T02:44:41.229315+0000","last_undegraded":"2024-04-13T02:44:41.229315+0000","last_fullsized":"2024-04-13T02:44:41.229315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229819+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:44:41.229819+0000","last_peered":"2024-04-13T02:44:41.229819+0000","last_clean":"2024-04-13T02:44:41.229819+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:44:41.229819+0000","last_undegraded":"2024-04-13T02:44:41.229819+0000","last_fullsized":"2024-04-13T02:44:41.229819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286679+0000","last_change":"2024-04-13T02:44:39.223022+0000","last_active":"2024-04-13T02:44:41.286679+0000","last_peered":"2024-04-13T02:44:41.286679+0000","last_clean":"2024-04-13T02:44:41.286679+0000","last_became_active":"2024-04-13T02:44:39.222581+0000","last_became_peered":"2024-04-13T02:44:39.222581+0000","last_unstale":"2024-04-13T02:44:41.286679+0000","last_undegraded":"2024-04-13T02:44:41.286679+0000","last_fullsized":"2024-04-13T02:44:41.286679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287663+0000","last_change":"2024-04-13T02:44:40.237625+0000","last_active":"2024-04-13T02:44:41.287663+0000","last_peered":"2024-04-13T02:44:41.287663+0000","last_clean":"2024-04-13T02:44:41.287663+0000","last_became_active":"2024-04-13T02:44:40.237335+0000","last_became_peered":"2024-04-13T02:44:40.237335+0000","last_unstale":"2024-04-13T02:44:41.287663+0000","last_undegraded":"2024-04-13T02:44:41.287663+0000","last_fullsized":"2024-04-13T02:44:41.287663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229759+0000","last_change":"2024-04-13T02:44:39.223819+0000","last_active":"2024-04-13T02:44:41.229759+0000","last_peered":"2024-04-13T02:44:41.229759+0000","last_clean":"2024-04-13T02:44:41.229759+0000","last_became_active":"2024-04-13T02:44:39.223502+0000","last_became_peered":"2024-04-13T02:44:39.223502+0000","last_unstale":"2024-04-13T02:44:41.229759+0000","last_undegraded":"2024-04-13T02:44:41.229759+0000","last_fullsized":"2024-04-13T02:44:41.229759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:23.200046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286745+0000","last_change":"2024-04-13T02:44:40.227306+0000","last_active":"2024-04-13T02:44:41.286745+0000","last_peered":"2024-04-13T02:44:41.286745+0000","last_clean":"2024-04-13T02:44:41.286745+0000","last_became_active":"2024-04-13T02:44:40.227034+0000","last_became_peered":"2024-04-13T02:44:40.227034+0000","last_unstale":"2024-04-13T02:44:41.286745+0000","last_undegraded":"2024-04-13T02:44:41.286745+0000","last_fullsized":"2024-04-13T02:44:41.286745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:12:10.847444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286791+0000","last_change":"2024-04-13T02:44:39.221174+0000","last_active":"2024-04-13T02:44:41.286791+0000","last_peered":"2024-04-13T02:44:41.286791+0000","last_clean":"2024-04-13T02:44:41.286791+0000","last_became_active":"2024-04-13T02:44:39.220885+0000","last_became_peered":"2024-04-13T02:44:39.220885+0000","last_unstale":"2024-04-13T02:44:41.286791+0000","last_undegraded":"2024-04-13T02:44:41.286791+0000","last_fullsized":"2024-04-13T02:44:41.286791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223245+0000","last_change":"2024-04-13T02:44:40.222634+0000","last_active":"2024-04-13T02:44:41.223245+0000","last_peered":"2024-04-13T02:44:41.223245+0000","last_clean":"2024-04-13T02:44:41.223245+0000","last_became_active":"2024-04-13T02:44:40.222243+0000","last_became_peered":"2024-04-13T02:44:40.222243+0000","last_unstale":"2024-04-13T02:44:41.223245+0000","last_undegraded":"2024-04-13T02:44:41.223245+0000","last_fullsized":"2024-04-13T02:44:41.223245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287055+0000","last_change":"2024-04-13T02:44:39.223485+0000","last_active":"2024-04-13T02:44:41.287055+0000","last_peered":"2024-04-13T02:44:41.287055+0000","last_clean":"2024-04-13T02:44:41.287055+0000","last_became_active":"2024-04-13T02:44:39.223163+0000","last_became_peered":"2024-04-13T02:44:39.223163+0000","last_unstale":"2024-04-13T02:44:41.287055+0000","last_undegraded":"2024-04-13T02:44:41.287055+0000","last_fullsized":"2024-04-13T02:44:41.287055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:43.259767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231172+0000","last_change":"2024-04-13T02:44:40.222929+0000","last_active":"2024-04-13T02:44:41.231172+0000","last_peered":"2024-04-13T02:44:41.231172+0000","last_clean":"2024-04-13T02:44:41.231172+0000","last_became_active":"2024-04-13T02:44:40.222596+0000","last_became_peered":"2024-04-13T02:44:40.222596+0000","last_unstale":"2024-04-13T02:44:41.231172+0000","last_undegraded":"2024-04-13T02:44:41.231172+0000","last_fullsized":"2024-04-13T02:44:41.231172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:44.263761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223367+0000","last_change":"2024-04-13T02:44:39.223044+0000","last_active":"2024-04-13T02:44:41.223367+0000","last_peered":"2024-04-13T02:44:41.223367+0000","last_clean":"2024-04-13T02:44:41.223367+0000","last_became_active":"2024-04-13T02:44:39.222291+0000","last_became_peered":"2024-04-13T02:44:39.222291+0000","last_unstale":"2024-04-13T02:44:41.223367+0000","last_undegraded":"2024-04-13T02:44:41.223367+0000","last_fullsized":"2024-04-13T02:44:41.223367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287274+0000","last_change":"2024-04-13T02:44:40.233688+0000","last_active":"2024-04-13T02:44:41.287274+0000","last_peered":"2024-04-13T02:44:41.287274+0000","last_clean":"2024-04-13T02:44:41.287274+0000","last_became_active":"2024-04-13T02:44:40.232532+0000","last_became_peered":"2024-04-13T02:44:40.232532+0000","last_unstale":"2024-04-13T02:44:41.287274+0000","last_undegraded":"2024-04-13T02:44:41.287274+0000","last_fullsized":"2024-04-13T02:44:41.287274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:09:46.354760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229734+0000","last_change":"2024-04-13T02:44:39.221704+0000","last_active":"2024-04-13T02:44:41.229734+0000","last_peered":"2024-04-13T02:44:41.229734+0000","last_clean":"2024-04-13T02:44:41.229734+0000","last_became_active":"2024-04-13T02:44:39.221381+0000","last_became_peered":"2024-04-13T02:44:39.221381+0000","last_unstale":"2024-04-13T02:44:41.229734+0000","last_undegraded":"2024-04-13T02:44:41.229734+0000","last_fullsized":"2024-04-13T02:44:41.229734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:12:11.858201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223232+0000","last_change":"2024-04-13T02:44:40.226440+0000","last_active":"2024-04-13T02:44:41.223232+0000","last_peered":"2024-04-13T02:44:41.223232+0000","last_clean":"2024-04-13T02:44:41.223232+0000","last_became_active":"2024-04-13T02:44:40.225635+0000","last_became_peered":"2024-04-13T02:44:40.225635+0000","last_unstale":"2024-04-13T02:44:41.223232+0000","last_undegraded":"2024-04-13T02:44:41.223232+0000","last_fullsized":"2024-04-13T02:44:41.223232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.227924+0000","last_change":"2024-04-13T02:44:39.222891+0000","last_active":"2024-04-13T02:44:41.227924+0000","last_peered":"2024-04-13T02:44:41.227924+0000","last_clean":"2024-04-13T02:44:41.227924+0000","last_became_active":"2024-04-13T02:44:39.222401+0000","last_became_peered":"2024-04-13T02:44:39.222401+0000","last_unstale":"2024-04-13T02:44:41.227924+0000","last_undegraded":"2024-04-13T02:44:41.227924+0000","last_fullsized":"2024-04-13T02:44:41.227924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.288052+0000","last_change":"2024-04-13T02:44:40.229666+0000","last_active":"2024-04-13T02:44:41.288052+0000","last_peered":"2024-04-13T02:44:41.288052+0000","last_clean":"2024-04-13T02:44:41.288052+0000","last_became_active":"2024-04-13T02:44:40.229394+0000","last_became_peered":"2024-04-13T02:44:40.229394+0000","last_unstale":"2024-04-13T02:44:41.288052+0000","last_undegraded":"2024-04-13T02:44:41.288052+0000","last_fullsized":"2024-04-13T02:44:41.288052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230066+0000","last_change":"2024-04-13T02:44:39.220188+0000","last_active":"2024-04-13T02:44:41.230066+0000","last_peered":"2024-04-13T02:44:41.230066+0000","last_clean":"2024-04-13T02:44:41.230066+0000","last_became_active":"2024-04-13T02:44:39.219872+0000","last_became_peered":"2024-04-13T02:44:39.219872+0000","last_unstale":"2024-04-13T02:44:41.230066+0000","last_undegraded":"2024-04-13T02:44:41.230066+0000","last_fullsized":"2024-04-13T02:44:41.230066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287012+0000","last_change":"2024-04-13T02:44:40.228870+0000","last_active":"2024-04-13T02:44:41.287012+0000","last_peered":"2024-04-13T02:44:41.287012+0000","last_clean":"2024-04-13T02:44:41.287012+0000","last_became_active":"2024-04-13T02:44:40.228525+0000","last_became_peered":"2024-04-13T02:44:40.228525+0000","last_unstale":"2024-04-13T02:44:41.287012+0000","last_undegraded":"2024-04-13T02:44:41.287012+0000","last_fullsized":"2024-04-13T02:44:41.287012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228895+0000","last_change":"2024-04-13T02:44:39.217842+0000","last_active":"2024-04-13T02:44:41.228895+0000","last_peered":"2024-04-13T02:44:41.228895+0000","last_clean":"2024-04-13T02:44:41.228895+0000","last_became_active":"2024-04-13T02:44:39.217486+0000","last_became_peered":"2024-04-13T02:44:39.217486+0000","last_unstale":"2024-04-13T02:44:41.228895+0000","last_undegraded":"2024-04-13T02:44:41.228895+0000","last_fullsized":"2024-04-13T02:44:41.228895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:29.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230940+0000","last_change":"2024-04-13T02:44:40.217868+0000","last_active":"2024-04-13T02:44:41.230940+0000","last_peered":"2024-04-13T02:44:41.230940+0000","last_clean":"2024-04-13T02:44:41.230940+0000","last_became_active":"2024-04-13T02:44:40.217588+0000","last_became_peered":"2024-04-13T02:44:40.217588+0000","last_unstale":"2024-04-13T02:44:41.230940+0000","last_undegraded":"2024-04-13T02:44:41.230940+0000","last_fullsized":"2024-04-13T02:44:41.230940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:01.746931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223252+0000","last_change":"2024-04-13T02:44:39.220393+0000","last_active":"2024-04-13T02:44:41.223252+0000","last_peered":"2024-04-13T02:44:41.223252+0000","last_clean":"2024-04-13T02:44:41.223252+0000","last_became_active":"2024-04-13T02:44:39.220122+0000","last_became_peered":"2024-04-13T02:44:39.220122+0000","last_unstale":"2024-04-13T02:44:41.223252+0000","last_undegraded":"2024-04-13T02:44:41.223252+0000","last_fullsized":"2024-04-13T02:44:41.223252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:43.259767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287456+0000","last_change":"2024-04-13T02:44:40.227423+0000","last_active":"2024-04-13T02:44:41.287456+0000","last_peered":"2024-04-13T02:44:41.287456+0000","last_clean":"2024-04-13T02:44:41.287456+0000","last_became_active":"2024-04-13T02:44:40.227151+0000","last_became_peered":"2024-04-13T02:44:40.227151+0000","last_unstale":"2024-04-13T02:44:41.287456+0000","last_undegraded":"2024-04-13T02:44:41.287456+0000","last_fullsized":"2024-04-13T02:44:41.287456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223304+0000","last_change":"2024-04-13T02:44:39.222583+0000","last_active":"2024-04-13T02:44:41.223304+0000","last_peered":"2024-04-13T02:44:41.223304+0000","last_clean":"2024-04-13T02:44:41.223304+0000","last_became_active":"2024-04-13T02:44:39.222307+0000","last_became_peered":"2024-04-13T02:44:39.222307+0000","last_unstale":"2024-04-13T02:44:41.223304+0000","last_undegraded":"2024-04-13T02:44:41.223304+0000","last_fullsized":"2024-04-13T02:44:41.223304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287720+0000","last_change":"2024-04-13T02:44:40.223063+0000","last_active":"2024-04-13T02:44:41.287720+0000","last_peered":"2024-04-13T02:44:41.287720+0000","last_clean":"2024-04-13T02:44:41.287720+0000","last_became_active":"2024-04-13T02:44:40.222790+0000","last_became_peered":"2024-04-13T02:44:40.222790+0000","last_unstale":"2024-04-13T02:44:41.287720+0000","last_undegraded":"2024-04-13T02:44:41.287720+0000","last_fullsized":"2024-04-13T02:44:41.287720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:22:29.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230357+0000","last_change":"2024-04-13T02:44:39.215575+0000","last_active":"2024-04-13T02:44:41.230357+0000","last_peered":"2024-04-13T02:44:41.230357+0000","last_clean":"2024-04-13T02:44:41.230357+0000","last_became_active":"2024-04-13T02:44:39.215199+0000","last_became_peered":"2024-04-13T02:44:39.215199+0000","last_unstale":"2024-04-13T02:44:41.230357+0000","last_undegraded":"2024-04-13T02:44:41.230357+0000","last_fullsized":"2024-04-13T02:44:41.230357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:17:32.443063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228884+0000","last_change":"2024-04-13T02:44:40.226463+0000","last_active":"2024-04-13T02:44:41.228884+0000","last_peered":"2024-04-13T02:44:41.228884+0000","last_clean":"2024-04-13T02:44:41.228884+0000","last_became_active":"2024-04-13T02:44:40.226185+0000","last_became_peered":"2024-04-13T02:44:40.226185+0000","last_unstale":"2024-04-13T02:44:41.228884+0000","last_undegraded":"2024-04-13T02:44:41.228884+0000","last_fullsized":"2024-04-13T02:44:41.228884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287104+0000","last_change":"2024-04-13T02:44:40.238975+0000","last_active":"2024-04-13T02:44:41.287104+0000","last_peered":"2024-04-13T02:44:41.287104+0000","last_clean":"2024-04-13T02:44:41.287104+0000","last_became_active":"2024-04-13T02:44:40.238416+0000","last_became_peered":"2024-04-13T02:44:40.238416+0000","last_unstale":"2024-04-13T02:44:41.287104+0000","last_undegraded":"2024-04-13T02:44:41.287104+0000","last_fullsized":"2024-04-13T02:44:41.287104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:38:37.826515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229450+0000","last_change":"2024-04-13T02:44:39.224883+0000","last_active":"2024-04-13T02:44:41.229450+0000","last_peered":"2024-04-13T02:44:41.229450+0000","last_clean":"2024-04-13T02:44:41.229450+0000","last_became_active":"2024-04-13T02:44:39.224587+0000","last_became_peered":"2024-04-13T02:44:39.224587+0000","last_unstale":"2024-04-13T02:44:41.229450+0000","last_undegraded":"2024-04-13T02:44:41.229450+0000","last_fullsized":"2024-04-13T02:44:41.229450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:43:18.401558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286778+0000","last_change":"2024-04-13T02:44:40.239119+0000","last_active":"2024-04-13T02:44:41.286778+0000","last_peered":"2024-04-13T02:44:41.286778+0000","last_clean":"2024-04-13T02:44:41.286778+0000","last_became_active":"2024-04-13T02:44:40.238841+0000","last_became_peered":"2024-04-13T02:44:40.238841+0000","last_unstale":"2024-04-13T02:44:41.286778+0000","last_undegraded":"2024-04-13T02:44:41.286778+0000","last_fullsized":"2024-04-13T02:44:41.286778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229347+0000","last_change":"2024-04-13T02:44:39.219315+0000","last_active":"2024-04-13T02:44:41.229347+0000","last_peered":"2024-04-13T02:44:41.229347+0000","last_clean":"2024-04-13T02:44:41.229347+0000","last_became_active":"2024-04-13T02:44:39.218997+0000","last_became_peered":"2024-04-13T02:44:39.218997+0000","last_unstale":"2024-04-13T02:44:41.229347+0000","last_undegraded":"2024-04-13T02:44:41.229347+0000","last_fullsized":"2024-04-13T02:44:41.229347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:08:03.429097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287022+0000","last_change":"2024-04-13T02:44:40.237798+0000","last_active":"2024-04-13T02:44:41.287022+0000","last_peered":"2024-04-13T02:44:41.287022+0000","last_clean":"2024-04-13T02:44:41.287022+0000","last_became_active":"2024-04-13T02:44:40.237420+0000","last_became_peered":"2024-04-13T02:44:40.237420+0000","last_unstale":"2024-04-13T02:44:41.287022+0000","last_undegraded":"2024-04-13T02:44:41.287022+0000","last_fullsized":"2024-04-13T02:44:41.287022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287851+0000","last_change":"2024-04-13T02:44:39.216773+0000","last_active":"2024-04-13T02:44:41.287851+0000","last_peered":"2024-04-13T02:44:41.287851+0000","last_clean":"2024-04-13T02:44:41.287851+0000","last_became_active":"2024-04-13T02:44:39.216483+0000","last_became_peered":"2024-04-13T02:44:39.216483+0000","last_unstale":"2024-04-13T02:44:41.287851+0000","last_undegraded":"2024-04-13T02:44:41.287851+0000","last_fullsized":"2024-04-13T02:44:41.287851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:36:17.093697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287891+0000","last_change":"2024-04-13T02:44:40.225518+0000","last_active":"2024-04-13T02:44:41.287891+0000","last_peered":"2024-04-13T02:44:41.287891+0000","last_clean":"2024-04-13T02:44:41.287891+0000","last_became_active":"2024-04-13T02:44:40.225251+0000","last_became_peered":"2024-04-13T02:44:40.225251+0000","last_unstale":"2024-04-13T02:44:41.287891+0000","last_undegraded":"2024-04-13T02:44:41.287891+0000","last_fullsized":"2024-04-13T02:44:41.287891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:28:51.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287116+0000","last_change":"2024-04-13T02:44:39.224484+0000","last_active":"2024-04-13T02:44:41.287116+0000","last_peered":"2024-04-13T02:44:41.287116+0000","last_clean":"2024-04-13T02:44:41.287116+0000","last_became_active":"2024-04-13T02:44:39.224147+0000","last_became_peered":"2024-04-13T02:44:39.224147+0000","last_unstale":"2024-04-13T02:44:41.287116+0000","last_undegraded":"2024-04-13T02:44:41.287116+0000","last_fullsized":"2024-04-13T02:44:41.287116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:36:17.093697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:44:43.534 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-13T02:44:43.534 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-13T02:44:43.534 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-13T02:44:43.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-13T02:44:43.535 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-13T02:44:43.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.669+0000 7fb1eeac8640 1 Processor -- start 2024-04-13T02:44:43.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.669+0000 7fb1eeac8640 1 -- start start 2024-04-13T02:44:43.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1eeac8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1e815caf0 0x7fb1e80d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1eeac8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1e809b2a0 0x7fb1e80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1eeac8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e80cce20 con 0x7fb1e80d18b0 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1eeac8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e80d1dc0 con 0x7fb1e809b2a0 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1eeac8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e80b2270 con 0x7fb1e815caf0 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1e809b2a0 0x7fb1e80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1e809b2a0 0x7fb1e80b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52692/0 (socket says 172.21.15.114:52692) 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 -- 172.21.15.114:0/3503067498 learned_addr learned my addr 172.21.15.114:0/3503067498 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ec864640 1 --2- 172.21.15.114:0/3503067498 >> v2:172.21.15.130:3300/0 conn(0x7fb1e815caf0 0x7fb1e80d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 -- 172.21.15.114:0/3503067498 >> v2:172.21.15.130:3300/0 conn(0x7fb1e815caf0 msgr2=0x7fb1e80d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 --2- 172.21.15.114:0/3503067498 >> v2:172.21.15.130:3300/0 conn(0x7fb1e815caf0 0x7fb1e80d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 -- 172.21.15.114:0/3503067498 >> v1:172.21.15.130:6789/0 conn(0x7fb1e80d18b0 legacy=0x7fb1e809ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.670+0000 7fb1ed065640 1 -- 172.21.15.114:0/3503067498 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80b2550 con 0x7fb1e809b2a0 2024-04-13T02:44:43.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.671+0000 7fb1ed065640 1 --2- 172.21.15.114:0/3503067498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e80b3030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80737a0 tx=0x7fb1e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68057410dbf9b136 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:43.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.671+0000 7fb1e77fe640 1 -- 172.21.15.114:0/3503067498 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002ca80 con 0x7fb1e809b2a0 2024-04-13T02:44:43.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.671+0000 7fb1e77fe640 1 -- 172.21.15.114:0/3503067498 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e002cc20 con 0x7fb1e809b2a0 2024-04-13T02:44:43.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.671+0000 7fb1e77fe640 1 -- 172.21.15.114:0/3503067498 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00343f0 con 0x7fb1e809b2a0 2024-04-13T02:44:43.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.671+0000 7fb1eeac8640 1 -- 172.21.15.114:0/3503067498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 msgr2=0x7fb1e80b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.671+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/3503067498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e80b3030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80737a0 tx=0x7fb1e002bee0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.672+0000 7fb1eeac8640 1 -- 172.21.15.114:0/3503067498 shutdown_connections 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.672+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/3503067498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e80b3030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.672+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/3503067498 >> v2:172.21.15.130:3300/0 conn(0x7fb1e815caf0 0x7fb1e80d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.672+0000 7fb1eeac8640 1 -- 172.21.15.114:0/3503067498 >> 172.21.15.114:0/3503067498 conn(0x7fb1e80d27d0 msgr2=0x7fb1e80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.672+0000 7fb1eeac8640 1 -- 172.21.15.114:0/3503067498 shutdown_connections 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.672+0000 7fb1eeac8640 1 -- 172.21.15.114:0/3503067498 wait complete. 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.673+0000 7fb1eeac8640 1 Processor -- start 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.673+0000 7fb1eeac8640 1 -- start start 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e8156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1e80d18b0 0x7fb1e80c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e815caf0 0x7fb1e8071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e809b850 con 0x7fb1e809b2a0 2024-04-13T02:44:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80b2b10 con 0x7fb1e815caf0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e809b9d0 con 0x7fb1e80d18b0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e8156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e8156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52698/0 (socket says 172.21.15.114:52698) 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 -- 172.21.15.114:0/2021180892 learned_addr learned my addr 172.21.15.114:0/2021180892 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ed065640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e815caf0 0x7fb1e8071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1e7fff640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1e80d18b0 0x7fb1e80c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 -- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1e80d18b0 msgr2=0x7fb1e80c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1e80d18b0 0x7fb1e80c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 -- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e815caf0 msgr2=0x7fb1e8071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e815caf0 0x7fb1e8071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 -- 172.21.15.114:0/2021180892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80caea0 con 0x7fb1e809b2a0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1ec864640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e8156b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00c7f0 tx=0x7fb1dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc015070 con 0x7fb1e809b2a0 2024-04-13T02:44:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc004220 con 0x7fb1e809b2a0 2024-04-13T02:44:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e8157060 con 0x7fb1e809b2a0 2024-04-13T02:44:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc007620 con 0x7fb1e809b2a0 2024-04-13T02:44:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.674+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e80ca600 con 0x7fb1e809b2a0 2024-04-13T02:44:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.675+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e8068c80 con 0x7fb1e809b2a0 2024-04-13T02:44:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.676+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1dc0079d0 con 0x7fb1e809b2a0 2024-04-13T02:44:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.676+0000 7fb1e57fa640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb1cc06c8f0 0x7fb1cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.676+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb1dc08be10 con 0x7fb1e809b2a0 2024-04-13T02:44:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.676+0000 7fb1e7fff640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb1cc06c8f0 0x7fb1cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.676+0000 7fb1e7fff640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb1cc06c8f0 0x7fb1cc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1e815f950 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:43.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.680+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1dc05a2d0 con 0x7fb1e809b2a0 2024-04-13T02:44:43.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.902+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb1e80d2e70 con 0x7fb1e809b2a0 2024-04-13T02:44:43.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.905+0000 7fb1e57fa640 1 -- 172.21.15.114:0/2021180892 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7fb1dc059bd0 con 0x7fb1e809b2a0 2024-04-13T02:44:43.909 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb1cc06c8f0 msgr2=0x7fb1cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb1cc06c8f0 0x7fb1cc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1e815f950 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2024-04-13T02:44:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 msgr2=0x7fb1e8156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e8156b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00c7f0 tx=0x7fb1dc00ccb0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 shutdown_connections 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1e815caf0 0x7fb1e8071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb1cc06c8f0 0x7fb1cc06edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1e80d18b0 0x7fb1e80c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.907+0000 7fb1eeac8640 1 --2- 172.21.15.114:0/2021180892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1e809b2a0 0x7fb1e8156b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.908+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 >> 172.21.15.114:0/2021180892 conn(0x7fb1e80d27d0 msgr2=0x7fb1e8070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.908+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 shutdown_connections 2024-04-13T02:44:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:43.908+0000 7fb1eeac8640 1 -- 172.21.15.114:0/2021180892 wait complete. 2024-04-13T02:44:43.919 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1298227515},{"type":"v1","addr":"172.21.15.114:6833","nonce":1298227515}]},"active_addr":"172.21.15.114:6833/1298227515","active_change":"2024-04-13T02:44:19.479535+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":227336635}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2615990593}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":1330988805}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":1950189803}]}]} 2024-04-13T02:44:43.922 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-13T02:44:43.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-13T02:44:43.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:44.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.022+0000 7f2a83836640 1 Processor -- start 2024-04-13T02:44:44.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.022+0000 7f2a83836640 1 -- start start 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a83836640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a7c09b2a0 0x7f2a7c0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a83836640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2a7c0b3ec0 0x7f2a7c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a83836640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7c06cd90 con 0x7f2a7c15edb0 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a83836640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7c0cce20 con 0x7f2a7c09b2a0 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a83836640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7c06d070 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a7c09b2a0 0x7f2a7c0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a7c09b2a0 0x7f2a7c0cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52706/0 (socket says 172.21.15.114:52706) 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 -- 172.21.15.114:0/2874530506 learned_addr learned my addr 172.21.15.114:0/2874530506 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a81dd3640 1 --2- 172.21.15.114:0/2874530506 >> v2:172.21.15.130:3300/0 conn(0x7f2a7c0b3ec0 0x7f2a7c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 -- 172.21.15.114:0/2874530506 >> v2:172.21.15.130:3300/0 conn(0x7f2a7c0b3ec0 msgr2=0x7f2a7c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 --2- 172.21.15.114:0/2874530506 >> v2:172.21.15.130:3300/0 conn(0x7f2a7c0b3ec0 0x7f2a7c0cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 -- 172.21.15.114:0/2874530506 >> v1:172.21.15.130:6789/0 conn(0x7f2a7c15edb0 legacy=0x7f2a7c09ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.023+0000 7f2a80dd1640 1 -- 172.21.15.114:0/2874530506 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c0cd070 con 0x7f2a7c09b2a0 2024-04-13T02:44:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a80dd1640 1 --2- 172.21.15.114:0/2874530506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c09b2a0 0x7f2a7c0cd850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c162730 tx=0x7f2a6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762c18ce397298a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a73fff640 1 -- 172.21.15.114:0/2874530506 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c034070 con 0x7f2a7c09b2a0 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a73fff640 1 -- 172.21.15.114:0/2874530506 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c030860 con 0x7f2a7c09b2a0 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a73fff640 1 -- 172.21.15.114:0/2874530506 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c030c30 con 0x7f2a7c09b2a0 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a83836640 1 -- 172.21.15.114:0/2874530506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c09b2a0 msgr2=0x7f2a7c0cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a83836640 1 --2- 172.21.15.114:0/2874530506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c09b2a0 0x7f2a7c0cd850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c162730 tx=0x7f2a6c02b9a0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a83836640 1 -- 172.21.15.114:0/2874530506 shutdown_connections 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a83836640 1 --2- 172.21.15.114:0/2874530506 >> v2:172.21.15.130:3300/0 conn(0x7f2a7c0b3ec0 0x7f2a7c0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a83836640 1 --2- 172.21.15.114:0/2874530506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c09b2a0 0x7f2a7c0cd850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.024+0000 7f2a83836640 1 -- 172.21.15.114:0/2874530506 >> 172.21.15.114:0/2874530506 conn(0x7f2a7c0d27d0 msgr2=0x7f2a7c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.025+0000 7f2a83836640 1 -- 172.21.15.114:0/2874530506 shutdown_connections 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.025+0000 7f2a83836640 1 -- 172.21.15.114:0/2874530506 wait complete. 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 Processor -- start 2024-04-13T02:44:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 -- start start 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2a7c09b2a0 0x7f2a7c0b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 0x7f2a7c0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a7c15edb0 0x7f2a7c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06d450 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06ca40 con 0x7f2a7c15edb0 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a83836640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c06d5d0 con 0x7f2a7c09b2a0 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a80dd1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 0x7f2a7c0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a80dd1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 0x7f2a7c0b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52716/0 (socket says 172.21.15.114:52716) 2024-04-13T02:44:44.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.026+0000 7f2a80dd1640 1 -- 172.21.15.114:0/1838986117 learned_addr learned my addr 172.21.15.114:0/1838986117 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a81dd3640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a7c15edb0 0x7f2a7c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a815d2640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2a7c09b2a0 0x7f2a7c0b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a80dd1640 1 -- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2a7c09b2a0 msgr2=0x7f2a7c0b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a80dd1640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2a7c09b2a0 0x7f2a7c0b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a80dd1640 1 -- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a7c15edb0 msgr2=0x7f2a7c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a80dd1640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a7c15edb0 0x7f2a7c153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a80dd1640 1 -- 172.21.15.114:0/1838986117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c0ca990 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a80dd1640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 0x7f2a7c0b5ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c02b9e0 tx=0x7f2a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c034040 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c039d90 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c0cac00 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c043610 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.027+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c0b67a0 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.028+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c068c80 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.029+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a6c04a060 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.029+0000 7f2a71ffb640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2a6006c920 0x7f2a6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.029+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6c0adaf0 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.029+0000 7f2a815d2640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2a6006c920 0x7f2a6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.029+0000 7f2a815d2640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2a6006c920 0x7f2a6006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a78001780 tx=0x7f2a78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.033+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a6c03e070 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.102 INFO:tasks.ceph.mds.d.smithi130.stderr:2024-04-13T02:44:44.102+0000 7fce9f9f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:44:44.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.208+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a7c15e820 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.209+0000 7f2a71ffb640 1 -- 172.21.15.114:0/1838986117 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f2a6c07b8d0 con 0x7f2a7c0b3ec0 2024-04-13T02:44:44.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:44.210 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2a6006c920 msgr2=0x7f2a6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2a6006c920 0x7f2a6006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a78001780 tx=0x7f2a78009040 comp rx=0 tx=0).stop 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 msgr2=0x7f2a7c0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 0x7f2a7c0b5ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c02b9e0 tx=0x7f2a6c0046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 shutdown_connections 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a7c15edb0 0x7f2a7c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c0b3ec0 0x7f2a7c0b5ee0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2a6006c920 0x7f2a6006ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 --2- 172.21.15.114:0/1838986117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2a7c09b2a0 0x7f2a7c0b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 >> 172.21.15.114:0/1838986117 conn(0x7f2a7c0d27d0 msgr2=0x7f2a7c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 shutdown_connections 2024-04-13T02:44:44.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.211+0000 7f2a83836640 1 -- 172.21.15.114:0/1838986117 wait complete. 2024-04-13T02:44:44.222 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-13T02:44:44.223 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:44.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.322+0000 7fcf8de60640 1 Processor -- start 2024-04-13T02:44:44.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.322+0000 7fcf8de60640 1 -- start start 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf8de60640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf8809b2a0 0x7fcf880cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf8de60640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf880b3ec0 0x7fcf880cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf8de60640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf8806cd90 con 0x7fcf8815edb0 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf8de60640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcf880cce20 con 0x7fcf880b3ec0 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf8de60640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8806d070 con 0x7fcf8809b2a0 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf880b3ec0 0x7fcf880cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf880b3ec0 0x7fcf880cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52728/0 (socket says 172.21.15.114:52728) 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 -- 172.21.15.114:0/3703265909 learned_addr learned my addr 172.21.15.114:0/3703265909 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf86ffd640 1 --2- 172.21.15.114:0/3703265909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf8809b2a0 0x7fcf880cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 -- 172.21.15.114:0/3703265909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf8809b2a0 msgr2=0x7fcf880cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 --2- 172.21.15.114:0/3703265909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf8809b2a0 0x7fcf880cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 -- 172.21.15.114:0/3703265909 >> v1:172.21.15.130:6789/0 conn(0x7fcf8815edb0 legacy=0x7fcf8809ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.323+0000 7fcf87fff640 1 -- 172.21.15.114:0/3703265909 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf880cd070 con 0x7fcf880b3ec0 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.324+0000 7fcf87fff640 1 --2- 172.21.15.114:0/3703265909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf880b3ec0 0x7fcf880cdd90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009e50 tx=0x7fcf8002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b150ae2f8b0121 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.324+0000 7fcf867fc640 1 -- 172.21.15.114:0/3703265909 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8002ca70 con 0x7fcf880b3ec0 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.324+0000 7fcf867fc640 1 -- 172.21.15.114:0/3703265909 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8002cc10 con 0x7fcf880b3ec0 2024-04-13T02:44:44.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.324+0000 7fcf867fc640 1 -- 172.21.15.114:0/3703265909 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf800343f0 con 0x7fcf880b3ec0 2024-04-13T02:44:44.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 -- 172.21.15.114:0/3703265909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf880b3ec0 msgr2=0x7fcf880cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 --2- 172.21.15.114:0/3703265909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf880b3ec0 0x7fcf880cdd90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009e50 tx=0x7fcf8002bed0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 -- 172.21.15.114:0/3703265909 shutdown_connections 2024-04-13T02:44:44.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 --2- 172.21.15.114:0/3703265909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf8809b2a0 0x7fcf880cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 --2- 172.21.15.114:0/3703265909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf880b3ec0 0x7fcf880cdd90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 -- 172.21.15.114:0/3703265909 >> 172.21.15.114:0/3703265909 conn(0x7fcf880d27d0 msgr2=0x7fcf880d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 -- 172.21.15.114:0/3703265909 shutdown_connections 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.325+0000 7fcf8de60640 1 -- 172.21.15.114:0/3703265909 wait complete. 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.326+0000 7fcf8de60640 1 Processor -- start 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.326+0000 7fcf8de60640 1 -- start start 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf8de60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8809b2a0 0x7fcf881598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf8de60640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b3ec0 0x7fcf88161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf8de60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 0x7fcf880ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf8de60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8806d450 con 0x7fcf8815edb0 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf8de60640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8806ca40 con 0x7fcf8809b2a0 2024-04-13T02:44:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf8de60640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8806d5d0 con 0x7fcf880b3ec0 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 0x7fcf880ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 0x7fcf880ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52744/0 (socket says 172.21.15.114:52744) 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 -- 172.21.15.114:0/2837698453 learned_addr learned my addr 172.21.15.114:0/2837698453 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf86ffd640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b3ec0 0x7fcf88161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf877fe640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8809b2a0 0x7fcf881598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 -- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b3ec0 msgr2=0x7fcf88161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b3ec0 0x7fcf88161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 -- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8809b2a0 msgr2=0x7fcf881598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8809b2a0 0x7fcf881598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 -- 172.21.15.114:0/2837698453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8815f3e0 con 0x7fcf8815edb0 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf87fff640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 0x7fcf880ca1f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf80036040 tx=0x7fcf80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.327+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80043020 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.328+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8003e450 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.328+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80009510 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.328+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8815f6c0 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.328+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8815fc80 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.329+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf88068c60 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.329+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf80046020 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.329+0000 7fcf6ffff640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf7406c920 0x7fcf7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.330+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf800ae180 con 0x7fcf8815edb0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.330+0000 7fcf877fe640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf7406c920 0x7fcf7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.330+0000 7fcf877fe640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf7406c920 0x7fcf7406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf78004f60 tx=0x7fcf78007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.334+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf8004d030 con 0x7fcf8815edb0 2024-04-13T02:44:44.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.507+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf8809ac30 con 0x7fcf8815edb0 2024-04-13T02:44:44.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.509+0000 7fcf6ffff640 1 -- 172.21.15.114:0/2837698453 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fcf8007bff0 con 0x7fcf8815edb0 2024-04-13T02:44:44.509 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:44.510 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:44.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.510+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf7406c920 msgr2=0x7fcf7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.510+0000 7fcf8de60640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf7406c920 0x7fcf7406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf78004f60 tx=0x7fcf78007e30 comp rx=0 tx=0).stop 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 msgr2=0x7fcf880ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 0x7fcf880ca1f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf80036040 tx=0x7fcf80004a40 comp rx=0 tx=0).stop 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 shutdown_connections 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf8815edb0 0x7fcf880ca1f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf7406c920 0x7fcf7406ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf880b3ec0 0x7fcf88161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 --2- 172.21.15.114:0/2837698453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf8809b2a0 0x7fcf881598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 >> 172.21.15.114:0/2837698453 conn(0x7fcf880d27d0 msgr2=0x7fcf880ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 shutdown_connections 2024-04-13T02:44:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.511+0000 7fcf8de60640 1 -- 172.21.15.114:0/2837698453 wait complete. 2024-04-13T02:44:44.522 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-13T02:44:44.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-13T02:44:44.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-13T02:44:44.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-13T02:44:44.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-13T02:44:44.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-13T02:44:44.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-13T02:44:44.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-13T02:44:44.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.693+0000 7ff45b11e640 1 Processor -- start 2024-04-13T02:44:44.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.693+0000 7ff45b11e640 1 -- start start 2024-04-13T02:44:44.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7f45aad88640 1 Processor -- start 2024-04-13T02:44:44.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7fbca6174640 1 Processor -- start 2024-04-13T02:44:44.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7fbca6174640 1 -- start start 2024-04-13T02:44:44.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.693+0000 7fca041e0640 1 Processor -- start 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7f9d32236640 1 Processor -- start 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7f9d32236640 1 -- start start 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff45b11e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff454162ed0 0x7ff45406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff45b11e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4540d00e0 0x7ff4540702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff45b11e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff45406f810 0x7ff454166a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff45b11e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff4540d06a0 con 0x7ff4540d00e0 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff45b11e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff45406e240 con 0x7ff45406f810 2024-04-13T02:44:44.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff45b11e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540cf5b0 con 0x7ff454162ed0 2024-04-13T02:44:44.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7f45aad88640 1 -- start start 2024-04-13T02:44:44.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f8f0f80f640 1 Processor -- start 2024-04-13T02:44:44.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff453fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4540d00e0 0x7ff4540702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff453fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4540d00e0 0x7ff4540702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52752/0 (socket says 172.21.15.114:52752) 2024-04-13T02:44:44.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff453fff640 1 -- 172.21.15.114:0/778261472 learned_addr learned my addr 172.21.15.114:0/778261472 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff458eba640 1 --2- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff454162ed0 0x7ff45406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f8f0f80f640 1 -- start start 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.694+0000 7fca041e0640 1 -- start start 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca041e0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9fc145180 0x7fc9fc0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca041e0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9fc145560 0x7fc9fc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca041e0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc15f8c0 0x7fc9fc0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca041e0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc9fc0b1f70 con 0x7fc9fc145560 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca041e0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc9fc0d1a70 con 0x7fc9fc145180 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca041e0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc9fc15fef0 con 0x7fc9fc15f8c0 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca01f7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9fc145180 0x7fc9fc0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca01f7c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc9fc145180 0x7fc9fc0aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59464/0 (socket says 172.21.15.114:59464) 2024-04-13T02:44:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca01f7c640 1 -- 172.21.15.114:0/3172633215 learned_addr learned my addr 172.21.15.114:0/3172633215 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45aad88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a40708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45aad88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45a40d09b0 0x7f45a40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45aad88640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a406fb00 con 0x7f45a415a9a0 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45aad88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f45a40cfc80 con 0x7f45a40d09b0 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45aad88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f45a4070e80 con 0x7f45a4069170 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fbca6174640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbca0160a70 0x7fbca00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fbca6174640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fbca6174640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbca00b3e10 0x7fbca0166a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fbca6174640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbca01643e0 con 0x7fbca00b3e10 2024-04-13T02:44:44.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fbca6174640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fbca0160e50 con 0x7fbca0160a70 2024-04-13T02:44:44.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fbca6174640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbca00b64a0 con 0x7fbca0163ee0 2024-04-13T02:44:44.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7ff4596bb640 1 --2- 172.21.15.114:0/778261472 >> v2:172.21.15.130:3300/0 conn(0x7ff45406f810 0x7ff454166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45a8b24640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a40708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45a8b24640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a40708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41060/0 (socket says 172.21.15.114:41060) 2024-04-13T02:44:44.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f45a8b24640 1 -- 172.21.15.114:0/2496800273 learned_addr learned my addr 172.21.15.114:0/2496800273 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d32236640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9d240e3250 0x7f9d2404f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d32236640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 0x7f9d24052c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d32236640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d240531a0 0x7f9d24005e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fd69359e640 1 Processor -- start 2024-04-13T02:44:44.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d32236640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9d24050200 con 0x7f9d240531a0 2024-04-13T02:44:44.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fd69359e640 1 -- start start 2024-04-13T02:44:44.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fbc9ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbca00b3e10 0x7fbca0166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d32236640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9d240e3630 con 0x7f9d240e3250 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fbc9ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbca00b3e10 0x7fbca0166a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52768/0 (socket says 172.21.15.114:52768) 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fbc9ffff640 1 -- 172.21.15.114:0/2589510144 learned_addr learned my addr 172.21.15.114:0/2589510144 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d32236640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9d24053920 con 0x7f9d2404fda0 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 0x7f9d24052c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 0x7f9d24052c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41084/0 (socket says 172.21.15.114:41084) 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 -- 172.21.15.114:0/3108577847 learned_addr learned my addr 172.21.15.114:0/3108577847 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2b7fe640 1 --2- 172.21.15.114:0/3108577847 >> v2:172.21.15.130:3300/0 conn(0x7f9d240e3250 0x7f9d2404f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f9af0c05640 1 Processor -- start 2024-04-13T02:44:44.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7f9af0c05640 1 -- start start 2024-04-13T02:44:44.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fbc9f7fe640 1 --2- 172.21.15.114:0/2589510144 >> v2:172.21.15.130:3300/0 conn(0x7fbca0160a70 0x7fbca00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f45a3fff640 1 --2- 172.21.15.114:0/2496800273 >> v2:172.21.15.114:3300/0 conn(0x7f45a40d09b0 0x7f45a40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 -- 172.21.15.114:0/3108577847 >> v2:172.21.15.130:3300/0 conn(0x7f9d240e3250 msgr2=0x7f9d2404f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 --2- 172.21.15.114:0/3108577847 >> v2:172.21.15.130:3300/0 conn(0x7f9d240e3250 0x7f9d2404f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 -- 172.21.15.114:0/3108577847 >> v2:172.21.15.114:3300/0 conn(0x7f9d240531a0 msgr2=0x7f9d24005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 --2- 172.21.15.114:0/3108577847 >> v2:172.21.15.114:3300/0 conn(0x7f9d240531a0 0x7f9d24005e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7f9d2affd640 1 -- 172.21.15.114:0/3108577847 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d24053c00 con 0x7f9d2404fda0 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0f80f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8f08072640 0x7f8f080b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0f80f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f081631d0 con 0x7f8f08162df0 2024-04-13T02:44:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.695+0000 7fca0177b640 1 --2- 172.21.15.114:0/3172633215 >> v2:172.21.15.114:3300/0 conn(0x7fc9fc145560 0x7fc9fc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fca01f7c640 1 -- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc15f8c0 msgr2=0x7fc9fc0b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fca01f7c640 1 --2- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc15f8c0 0x7fc9fc0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fca01f7c640 1 -- 172.21.15.114:0/3172633215 >> v2:172.21.15.114:3300/0 conn(0x7fc9fc145560 msgr2=0x7fc9fc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fca01f7c640 1 --2- 172.21.15.114:0/3172633215 >> v2:172.21.15.114:3300/0 conn(0x7fc9fc145560 0x7fc9fc15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7fca01f7c640 1 -- 172.21.15.114:0/3172633215 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc1601d0 con 0x7fc9fc145180 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0f80f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f0806f080 con 0x7f8f080b4970 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0f80f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8f080b45e0 con 0x7f8f08072640 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7ff4596bb640 1 -- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff454162ed0 msgr2=0x7ff45406fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7ff4596bb640 1 --2- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff454162ed0 0x7ff45406fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7ff4596bb640 1 -- 172.21.15.114:0/778261472 >> v2:172.21.15.114:3300/0 conn(0x7ff4540d00e0 msgr2=0x7ff4540702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7ff4596bb640 1 --2- 172.21.15.114:0/778261472 >> v2:172.21.15.114:3300/0 conn(0x7ff4540d00e0 0x7ff4540702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.696+0000 7ff4596bb640 1 -- 172.21.15.114:0/778261472 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4541632b0 con 0x7ff45406f810 2024-04-13T02:44:44.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0d5ab640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8f08162df0 0x7f8f08071f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58888/0 (socket says 172.21.15.114:58888) 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0d5ab640 1 -- 172.21.15.114:0/3129219357 learned_addr learned my addr 172.21.15.114:0/3129219357 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0cdaa640 1 --2- 172.21.15.114:0/3129219357 >> v2:172.21.15.130:3300/0 conn(0x7f8f08072640 0x7f8f080b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9effd640 1 --2- 172.21.15.114:0/2589510144 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9af0c05640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9aec15aa10 0x7f9aec0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9af0c05640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 0x7f9aec0af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9af0c05640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aec0b3a00 con 0x7f9aec0702d0 2024-04-13T02:44:44.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9af0c05640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9aec0afc50 con 0x7f9aec15aa10 2024-04-13T02:44:44.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9af0c05640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec0b3ce0 con 0x7f9aec0728f0 2024-04-13T02:44:44.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f45a37fe640 1 -- 172.21.15.114:0/2496800273 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945639721 0 0) 0x7f45a406fb00 con 0x7f45a415a9a0 2024-04-13T02:44:44.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f45a37fe640 1 -- 172.21.15.114:0/2496800273 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4590003520 con 0x7f45a415a9a0 2024-04-13T02:44:44.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9ffff640 1 -- 172.21.15.114:0/2589510144 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 msgr2=0x7fbca00cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9ffff640 1 --2- 172.21.15.114:0/2589510144 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca00cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9ffff640 1 -- 172.21.15.114:0/2589510144 >> v2:172.21.15.130:3300/0 conn(0x7fbca0160a70 msgr2=0x7fbca00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9ffff640 1 --2- 172.21.15.114:0/2589510144 >> v2:172.21.15.130:3300/0 conn(0x7fbca0160a70 0x7fbca00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9ffff640 1 -- 172.21.15.114:0/2589510144 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca00b6780 con 0x7fbca00b3e10 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fbc9f7fe640 1 --2- 172.21.15.114:0/2589510144 >> v2:172.21.15.130:3300/0 conn(0x7fbca0160a70 0x7fbca00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9aead9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 0x7f9aec0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f45a8b24640 1 -- 172.21.15.114:0/2496800273 >> v2:172.21.15.114:3300/0 conn(0x7f45a40d09b0 msgr2=0x7f45a40cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f45a8b24640 1 --2- 172.21.15.114:0/2496800273 >> v2:172.21.15.114:3300/0 conn(0x7f45a40d09b0 0x7f45a40cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f45a8b24640 1 -- 172.21.15.114:0/2496800273 >> v1:172.21.15.114:6789/0 conn(0x7f45a415a9a0 legacy=0x7f45a406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fca01f7c640 1 --2- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc145180 0x7fc9fc0aee70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc072e90 tx=0x7fc9f4034780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7963a4be941cdf53 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9aead9d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 0x7f9aec0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41100/0 (socket says 172.21.15.114:41100) 2024-04-13T02:44:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f45a8b24640 1 -- 172.21.15.114:0/2496800273 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40cfed0 con 0x7f45a4069170 2024-04-13T02:44:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f9aead9d640 1 -- 172.21.15.114:0/282593447 learned_addr learned my addr 172.21.15.114:0/282593447 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7fd69359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd68c0df220 0x7fd68c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0cdaa640 1 -- 172.21.15.114:0/3129219357 >> v1:172.21.15.130:6789/0 conn(0x7f8f080b4970 legacy=0x7f8f080ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69359e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd68c0501a0 0x7fd68c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69359e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c0544c0 con 0x7fd68c053c70 2024-04-13T02:44:44.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9d2affd640 1 --2- 172.21.15.114:0/3108577847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 0x7f9d24052c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c02db70 tx=0x7f9d2c0a75f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82dd563f171f7cfd server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69359e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c0541e0 con 0x7fd68c0df220 2024-04-13T02:44:44.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69359e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c005f30 con 0x7fd68c0501a0 2024-04-13T02:44:44.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7ff4596bb640 1 --2- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45406f810 0x7ff454166a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4540afb40 tx=0x7ff44c02be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a92ec6d7d96a72 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7ff4537fe640 1 -- 172.21.15.114:0/778261472 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c039070 con 0x7ff45406f810 2024-04-13T02:44:44.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7ff4537fe640 1 -- 172.21.15.114:0/778261472 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c02cc20 con 0x7ff45406f810 2024-04-13T02:44:44.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7ff4537fe640 1 -- 172.21.15.114:0/778261472 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c034660 con 0x7ff45406f810 2024-04-13T02:44:44.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9aea59c640 1 --2- 172.21.15.114:0/282593447 >> v2:172.21.15.130:3300/0 conn(0x7f9aec15aa10 0x7f9aec0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd691d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd68c053c70 0x7fd68c04fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47648/0 (socket says 172.21.15.114:47648) 2024-04-13T02:44:44.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd691d9b640 1 -- 172.21.15.114:0/2140256886 learned_addr learned my addr 172.21.15.114:0/2140256886 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:44.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0cdaa640 1 -- 172.21.15.114:0/3129219357 >> v1:172.21.15.114:6789/0 conn(0x7f8f08162df0 legacy=0x7f8f08071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.697+0000 7f8f0cdaa640 1 -- 172.21.15.114:0/3129219357 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0806f9c0 con 0x7f8f08072640 2024-04-13T02:44:44.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69259c640 1 --2- 172.21.15.114:0/2140256886 >> v2:172.21.15.114:3300/0 conn(0x7fd68c0df220 0x7fd68c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9aead9d640 1 -- 172.21.15.114:0/282593447 >> v2:172.21.15.130:3300/0 conn(0x7f9aec15aa10 msgr2=0x7f9aec0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9aead9d640 1 --2- 172.21.15.114:0/282593447 >> v2:172.21.15.130:3300/0 conn(0x7f9aec15aa10 0x7f9aec0cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9aead9d640 1 -- 172.21.15.114:0/282593447 >> v1:172.21.15.114:6789/0 conn(0x7f9aec0702d0 legacy=0x7f9aec0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd692d9d640 1 --2- 172.21.15.114:0/2140256886 >> v2:172.21.15.130:3300/0 conn(0x7fd68c0501a0 0x7fd68c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9d2a7fc640 1 -- 172.21.15.114:0/3108577847 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0b3070 con 0x7f9d2404fda0 2024-04-13T02:44:44.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9d2a7fc640 1 -- 172.21.15.114:0/3108577847 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0ac870 con 0x7f9d2404fda0 2024-04-13T02:44:44.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9d2a7fc640 1 -- 172.21.15.114:0/3108577847 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0acce0 con 0x7f9d2404fda0 2024-04-13T02:44:44.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7f9aead9d640 1 -- 172.21.15.114:0/282593447 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec0b3fc0 con 0x7f9aec0728f0 2024-04-13T02:44:44.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69259c640 1 -- 172.21.15.114:0/2140256886 >> v2:172.21.15.130:3300/0 conn(0x7fd68c0501a0 msgr2=0x7fd68c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:44.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fd69259c640 1 --2- 172.21.15.114:0/2140256886 >> v2:172.21.15.130:3300/0 conn(0x7fd68c0501a0 0x7fd68c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fd69259c640 1 -- 172.21.15.114:0/2140256886 >> v1:172.21.15.130:6789/0 conn(0x7fd68c053c70 legacy=0x7fd68c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fbc9ffff640 1 --2- 172.21.15.114:0/2589510144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca00b3e10 0x7fbca0166a50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbca00684f0 tx=0x7fbc9802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3ec4b792d33da server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fd69159a640 1 -- 172.21.15.114:0/2140256886 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996271635 0 0) 0x7fd68c0544c0 con 0x7fd68c053c70 2024-04-13T02:44:44.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fd69259c640 1 -- 172.21.15.114:0/2140256886 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c006210 con 0x7fd68c0df220 2024-04-13T02:44:44.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fca00f7a640 1 -- 172.21.15.114:0/3172633215 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4040070 con 0x7fc9fc145180 2024-04-13T02:44:44.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.698+0000 7fca00f7a640 1 -- 172.21.15.114:0/3172633215 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f403b600 con 0x7fc9fc145180 2024-04-13T02:44:44.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f8f0cdaa640 1 --2- 172.21.15.114:0/3129219357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f08072640 0x7f8f080b40a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80097a0 tx=0x7f8ef802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c04778bc2784565 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 -- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc145180 msgr2=0x7fc9fc0aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 --2- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc145180 0x7fc9fc0aee70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc072e90 tx=0x7fc9f4034780 comp rx=0 tx=0).stop 2024-04-13T02:44:44.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fbc9e7fc640 1 -- 172.21.15.114:0/2589510144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9802ca80 con 0x7fbca00b3e10 2024-04-13T02:44:44.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fbc9e7fc640 1 -- 172.21.15.114:0/2589510144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9802cc20 con 0x7fbca00b3e10 2024-04-13T02:44:44.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 -- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45406f810 msgr2=0x7ff454166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 --2- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45406f810 0x7ff454166a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4540afb40 tx=0x7ff44c02be70 comp rx=0 tx=0).stop 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 -- 172.21.15.114:0/3172633215 shutdown_connections 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 --2- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc15f8c0 0x7fc9fc0b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 --2- 172.21.15.114:0/3172633215 >> v2:172.21.15.114:3300/0 conn(0x7fc9fc145560 0x7fc9fc15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 --2- 172.21.15.114:0/3172633215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc145180 0x7fc9fc0aee70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fca041e0640 1 -- 172.21.15.114:0/3172633215 >> 172.21.15.114:0/3172633215 conn(0x7fc9fc09aa40 msgr2=0x7fc9fc09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7fbc9e7fc640 1 -- 172.21.15.114:0/2589510144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9802ca80 con 0x7fbca00b3e10 2024-04-13T02:44:44.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 -- 172.21.15.114:0/778261472 shutdown_connections 2024-04-13T02:44:44.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 --2- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff45406f810 0x7ff454166a50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 --2- 172.21.15.114:0/778261472 >> v2:172.21.15.114:3300/0 conn(0x7ff4540d00e0 0x7ff4540702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 --2- 172.21.15.114:0/778261472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff454162ed0 0x7ff45406fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 -- 172.21.15.114:0/778261472 >> 172.21.15.114:0/778261472 conn(0x7ff45406b930 msgr2=0x7ff45406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f8efffff640 1 -- 172.21.15.114:0/3129219357 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8035020 con 0x7f8f08072640 2024-04-13T02:44:44.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f45a8b24640 1 --2- 172.21.15.114:0/2496800273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a40708a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f459c009870 tx=0x7f459c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1920c2ed87383c94 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 -- 172.21.15.114:0/778261472 shutdown_connections 2024-04-13T02:44:44.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 -- 172.21.15.114:0/3108577847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 msgr2=0x7f9d24052c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 --2- 172.21.15.114:0/3108577847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 0x7f9d24052c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c02db70 tx=0x7f9d2c0a75f0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f8efffff640 1 -- 172.21.15.114:0/3129219357 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8031830 con 0x7f8f08072640 2024-04-13T02:44:44.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f8efffff640 1 -- 172.21.15.114:0/3129219357 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8031c00 con 0x7f8f08072640 2024-04-13T02:44:44.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 -- 172.21.15.114:0/3108577847 shutdown_connections 2024-04-13T02:44:44.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 --2- 172.21.15.114:0/3108577847 >> v2:172.21.15.114:3300/0 conn(0x7f9d240531a0 0x7f9d24005e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 --2- 172.21.15.114:0/3108577847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d2404fda0 0x7f9d24052c60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 --2- 172.21.15.114:0/3108577847 >> v2:172.21.15.130:3300/0 conn(0x7f9d240e3250 0x7f9d2404f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f9d32236640 1 -- 172.21.15.114:0/3108577847 >> 172.21.15.114:0/3108577847 conn(0x7f9d24009fa0 msgr2=0x7f9d2400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f45a37fe640 1 -- 172.21.15.114:0/2496800273 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c02f830 con 0x7f45a4069170 2024-04-13T02:44:44.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f45a37fe640 1 -- 172.21.15.114:0/2496800273 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c02f9d0 con 0x7f45a4069170 2024-04-13T02:44:44.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7f45a37fe640 1 -- 172.21.15.114:0/2496800273 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c02f830 con 0x7f45a4069170 2024-04-13T02:44:44.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f9aead9d640 1 --2- 172.21.15.114:0/282593447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 0x7f9aec0af710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009870 tx=0x7f9adc02b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f7c8f63978a22e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 -- 172.21.15.114:0/2589510144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca00b3e10 msgr2=0x7fbca0166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 --2- 172.21.15.114:0/2589510144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca00b3e10 0x7fbca0166a50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbca00684f0 tx=0x7fbc9802bee0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f9ae959a640 1 -- 172.21.15.114:0/282593447 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc037070 con 0x7f9aec0728f0 2024-04-13T02:44:44.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f9ae959a640 1 -- 172.21.15.114:0/282593447 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc030710 con 0x7f9aec0728f0 2024-04-13T02:44:44.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f9ae959a640 1 -- 172.21.15.114:0/282593447 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc030ae0 con 0x7f9aec0728f0 2024-04-13T02:44:44.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.699+0000 7ff45b11e640 1 -- 172.21.15.114:0/778261472 wait complete. 2024-04-13T02:44:44.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 -- 172.21.15.114:0/2589510144 shutdown_connections 2024-04-13T02:44:44.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 --2- 172.21.15.114:0/2589510144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca00b3e10 0x7fbca0166a50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 --2- 172.21.15.114:0/2589510144 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca00cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 --2- 172.21.15.114:0/2589510144 >> v2:172.21.15.130:3300/0 conn(0x7fbca0160a70 0x7fbca00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 -- 172.21.15.114:0/2589510144 >> 172.21.15.114:0/2589510144 conn(0x7fbca006d5f0 msgr2=0x7fbca00d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fca041e0640 1 -- 172.21.15.114:0/3172633215 shutdown_connections 2024-04-13T02:44:44.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fd69259c640 1 --2- 172.21.15.114:0/2140256886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0df220 0x7fd68c038080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd68c033e80 tx=0x7fd68802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ce9fab3f6f4112 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 -- 172.21.15.114:0/2589510144 shutdown_connections 2024-04-13T02:44:44.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fbca6174640 1 -- 172.21.15.114:0/2589510144 wait complete. 2024-04-13T02:44:44.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fca041e0640 1 -- 172.21.15.114:0/3172633215 wait complete. 2024-04-13T02:44:44.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fd69159a640 1 -- 172.21.15.114:0/2140256886 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880317c0 con 0x7fd68c0df220 2024-04-13T02:44:44.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f8f0f80f640 1 -- 172.21.15.114:0/3129219357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f08072640 msgr2=0x7f8f080b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f8f0f80f640 1 --2- 172.21.15.114:0/3129219357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f08072640 0x7f8f080b40a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80097a0 tx=0x7f8ef802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fd69159a640 1 -- 172.21.15.114:0/2140256886 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688037070 con 0x7fd68c0df220 2024-04-13T02:44:44.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7fd69159a640 1 -- 172.21.15.114:0/2140256886 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688031b80 con 0x7fd68c0df220 2024-04-13T02:44:44.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f8f0f80f640 1 -- 172.21.15.114:0/3129219357 shutdown_connections 2024-04-13T02:44:44.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f8f0f80f640 1 --2- 172.21.15.114:0/3129219357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f08072640 0x7f8f080b40a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f45aad88640 1 -- 172.21.15.114:0/2496800273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 msgr2=0x7f45a40708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f45aad88640 1 --2- 172.21.15.114:0/2496800273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a40708a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f459c009870 tx=0x7f459c02ba10 comp rx=0 tx=0).stop 2024-04-13T02:44:44.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.700+0000 7f8f0f80f640 1 -- 172.21.15.114:0/3129219357 >> 172.21.15.114:0/3129219357 conn(0x7f8f0806b930 msgr2=0x7f8f0806bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f45aad88640 1 -- 172.21.15.114:0/2496800273 shutdown_connections 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f45aad88640 1 --2- 172.21.15.114:0/2496800273 >> v2:172.21.15.114:3300/0 conn(0x7f45a40d09b0 0x7f45a40cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f45aad88640 1 --2- 172.21.15.114:0/2496800273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a40708a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f45aad88640 1 -- 172.21.15.114:0/2496800273 >> 172.21.15.114:0/2496800273 conn(0x7f45a40b2bd0 msgr2=0x7f45a40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f45aad88640 1 -- 172.21.15.114:0/2496800273 shutdown_connections 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f45aad88640 1 -- 172.21.15.114:0/2496800273 wait complete. 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f8f0f80f640 1 -- 172.21.15.114:0/3129219357 shutdown_connections 2024-04-13T02:44:44.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f9d32236640 1 -- 172.21.15.114:0/3108577847 shutdown_connections 2024-04-13T02:44:44.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7ff45b11e640 1 Processor -- start 2024-04-13T02:44:44.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f9af0c05640 1 -- 172.21.15.114:0/282593447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 msgr2=0x7f9aec0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7ff45b11e640 1 -- start start 2024-04-13T02:44:44.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f9af0c05640 1 --2- 172.21.15.114:0/282593447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 0x7f9aec0af710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009870 tx=0x7f9adc02b740 comp rx=0 tx=0).stop 2024-04-13T02:44:44.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f9af0c05640 1 -- 172.21.15.114:0/282593447 shutdown_connections 2024-04-13T02:44:44.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f9af0c05640 1 --2- 172.21.15.114:0/282593447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0728f0 0x7f9aec0af710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7fd69359e640 1 -- 172.21.15.114:0/2140256886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0df220 msgr2=0x7fd68c038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7fd69359e640 1 --2- 172.21.15.114:0/2140256886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0df220 0x7fd68c038080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd68c033e80 tx=0x7fd68802b860 comp rx=0 tx=0).stop 2024-04-13T02:44:44.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7f9af0c05640 1 --2- 172.21.15.114:0/282593447 >> v2:172.21.15.130:3300/0 conn(0x7f9aec15aa10 0x7f9aec0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7f9af0c05640 1 -- 172.21.15.114:0/282593447 >> 172.21.15.114:0/282593447 conn(0x7f9aec0b27b0 msgr2=0x7f9aec0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f9d32236640 1 -- 172.21.15.114:0/3108577847 wait complete. 2024-04-13T02:44:44.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fd69359e640 1 -- 172.21.15.114:0/2140256886 shutdown_connections 2024-04-13T02:44:44.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fd69359e640 1 --2- 172.21.15.114:0/2140256886 >> v2:172.21.15.130:3300/0 conn(0x7fd68c0501a0 0x7fd68c006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fd69359e640 1 --2- 172.21.15.114:0/2140256886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0df220 0x7fd68c038080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fd69359e640 1 -- 172.21.15.114:0/2140256886 >> 172.21.15.114:0/2140256886 conn(0x7fd68c009fb0 msgr2=0x7fd68c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fca041e0640 1 Processor -- start 2024-04-13T02:44:44.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.701+0000 7f8f0f80f640 1 -- 172.21.15.114:0/3129219357 wait complete. 2024-04-13T02:44:44.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fd69359e640 1 -- 172.21.15.114:0/2140256886 shutdown_connections 2024-04-13T02:44:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fd69359e640 1 -- 172.21.15.114:0/2140256886 wait complete. 2024-04-13T02:44:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fca041e0640 1 -- start start 2024-04-13T02:44:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fbca6174640 1 Processor -- start 2024-04-13T02:44:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7f9af0c05640 1 -- 172.21.15.114:0/282593447 shutdown_connections 2024-04-13T02:44:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7fbca6174640 1 -- start start 2024-04-13T02:44:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.702+0000 7f45aad88640 1 Processor -- start 2024-04-13T02:44:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff45b11e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff45406f810 0x7ff4541467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff45b11e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4540d00e0 0x7ff454161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff45b11e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff454162ed0 0x7ff45415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff453fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4540d00e0 0x7ff454161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff453fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4540d00e0 0x7ff454161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41112/0 (socket says 172.21.15.114:41112) 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff453fff640 1 -- 172.21.15.114:0/1699368636 learned_addr learned my addr 172.21.15.114:0/1699368636 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff4596bb640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff454162ed0 0x7ff45415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff45b11e640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff454070ac0 con 0x7ff45406f810 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff45b11e640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4540cfb30 con 0x7ff454162ed0 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7ff45b11e640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff454070c40 con 0x7ff4540d00e0 2024-04-13T02:44:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7f9af0c05640 1 -- 172.21.15.114:0/282593447 wait complete. 2024-04-13T02:44:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7f8f0f80f640 1 Processor -- start 2024-04-13T02:44:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7f9d32236640 1 Processor -- start 2024-04-13T02:44:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7f9d32236640 1 -- start start 2024-04-13T02:44:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7fca041e0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc145180 0x7fc9fc13f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbca6174640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca00b3e10 0x7fbca00ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff453fff640 1 -- 172.21.15.114:0/1699368636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff454162ed0 msgr2=0x7ff45415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff453fff640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff454162ed0 0x7ff45415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff453fff640 1 -- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff45406f810 msgr2=0x7ff4541467c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-13T02:44:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbca6174640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0160a70 0x7fbca0072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbca6174640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff458eba640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff45406f810 0x7ff4541467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.703+0000 7f45aad88640 1 -- start start 2024-04-13T02:44:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45aad88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbca6174640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbca00b7260 con 0x7fbca0160a70 2024-04-13T02:44:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbca6174640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbca00b6d40 con 0x7fbca00b3e10 2024-04-13T02:44:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbca6174640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbca00b73e0 con 0x7fbca0163ee0 2024-04-13T02:44:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbc9f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca00b3e10 0x7fbca00ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45aad88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40d09b0 0x7f45a4151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff453fff640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff45406f810 0x7ff4541467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff453fff640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff454155bf0 con 0x7ff4540d00e0 2024-04-13T02:44:44.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbc9f7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca00b3e10 0x7fbca00ce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59548/0 (socket says 172.21.15.114:59548) 2024-04-13T02:44:44.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbc9f7fe640 1 -- 172.21.15.114:0/848663285 learned_addr learned my addr 172.21.15.114:0/848663285 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbc9ffff640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff458eba640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff45406f810 0x7ff4541467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:44.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fd69359e640 1 Processor -- start 2024-04-13T02:44:44.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45a8b24640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45a8b24640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a415cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41136/0 (socket says 172.21.15.114:41136) 2024-04-13T02:44:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff453fff640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4540d00e0 0x7ff454161950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e8d0 tx=0x7ff44400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45aad88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a415a9a0 0x7f45a4167f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca041e0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc145560 0x7fc9fc143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca041e0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc15f8c0 0x7fc9fc0ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca041e0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc0af3b0 con 0x7fc9fc145180 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca041e0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc0b1c00 con 0x7fc9fc15f8c0 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca041e0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc9fc0b7350 con 0x7fc9fc145560 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca01f7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc145180 0x7fc9fc13f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca0177b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc145560 0x7fc9fc143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca0177b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc145560 0x7fc9fc143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41152/0 (socket says 172.21.15.114:41152) 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca01f7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc145180 0x7fc9fc13f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52806/0 (socket says 172.21.15.114:52806) 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca0177b640 1 -- 172.21.15.114:0/3445246325 learned_addr learned my addr 172.21.15.114:0/3445246325 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fd69359e640 1 -- start start 2024-04-13T02:44:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45a3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40d09b0 0x7f45a4151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444017070 con 0x7ff4540d00e0 2024-04-13T02:44:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44400c940 con 0x7ff4540d00e0 2024-04-13T02:44:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400ccf0 con 0x7ff4540d00e0 2024-04-13T02:44:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7ff45b11e640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff454155ed0 con 0x7ff4540d00e0 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7f45a3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40d09b0 0x7f45a4151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52836/0 (socket says 172.21.15.114:52836) 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d32236640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d2404fda0 0x7f9d2404bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d32236640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d240531a0 0x7f9d2404a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d32236640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d240e3250 0x7f9d2404ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d32236640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9d240544a0 con 0x7f9d240531a0 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d32236640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9d240541c0 con 0x7f9d2404fda0 2024-04-13T02:44:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d32236640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9d24053630 con 0x7f9d240e3250 2024-04-13T02:44:44.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7ff45b11e640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff454156490 con 0x7ff4540d00e0 2024-04-13T02:44:44.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fbc9effd640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0160a70 0x7fbca0072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fbc9f7fe640 1 -- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 msgr2=0x7fbca015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fbc9f7fe640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbca0163ee0 0x7fbca015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fbc9f7fe640 1 -- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0160a70 msgr2=0x7fbca0072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9af0c05640 1 Processor -- start 2024-04-13T02:44:44.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fbc9f7fe640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0160a70 0x7fbca0072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9af0c05640 1 -- start start 2024-04-13T02:44:44.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fbc9f7fe640 1 -- 172.21.15.114:0/848663285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca006ecf0 con 0x7fbca00b3e10 2024-04-13T02:44:44.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fbc9effd640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0160a70 0x7fbca0072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:44.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f45aad88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f45a415ae10 con 0x7f45a40d09b0 2024-04-13T02:44:44.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f45aad88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40d0490 con 0x7f45a415a9a0 2024-04-13T02:44:44.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f45aad88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f45a406f3b0 con 0x7f45a4069170 2024-04-13T02:44:44.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.704+0000 7fca0277d640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc15f8c0 0x7fc9fc0ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fca0177b640 1 -- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc15f8c0 msgr2=0x7fc9fc0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f8f0f80f640 1 -- start start 2024-04-13T02:44:44.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fca0177b640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9fc15f8c0 0x7fc9fc0ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fca0177b640 1 -- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc145180 msgr2=0x7fc9fc13f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fca0177b640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc145180 0x7fc9fc13f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fca0177b640 1 -- 172.21.15.114:0/3445246325 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc1449a0 con 0x7fc9fc145560 2024-04-13T02:44:44.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69359e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd68c0501a0 0x7fd68c0d9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7fca01f7c640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc145180 0x7fc9fc13f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:44.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a8b24640 1 -- 172.21.15.114:0/2583809354 learned_addr learned my addr 172.21.15.114:0/2583809354 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a9325640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a415a9a0 0x7f45a4167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c053c70 0x7fd68c0479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69359e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd68c0df220 0x7fd68c04dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c037a90 con 0x7fd68c053c70 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69359e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c037910 con 0x7fd68c0df220 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69359e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0df600 con 0x7fd68c0501a0 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d2404fda0 0x7f9d2404bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d2404fda0 0x7f9d2404bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59560/0 (socket says 172.21.15.114:59560) 2024-04-13T02:44:44.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2b7fe640 1 -- 172.21.15.114:0/1253086433 learned_addr learned my addr 172.21.15.114:0/1253086433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fca0177b640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc145560 0x7fc9fc143630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00d990 tx=0x7fc9ec00dd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2affd640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d240531a0 0x7f9d2404a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2bfff640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d240e3250 0x7f9d2404ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2b7fe640 1 -- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d240e3250 msgr2=0x7f9d2404ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2b7fe640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9d240e3250 0x7f9d2404ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.705+0000 7f9d2b7fe640 1 -- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d240531a0 msgr2=0x7f9d2404a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9d2b7fe640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d240531a0 0x7f9d2404a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9d2b7fe640 1 -- 172.21.15.114:0/1253086433 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d240e54c0 con 0x7f9d2404fda0 2024-04-13T02:44:44.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9d2affd640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d240531a0 0x7f9d2404a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:44.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fbc9f7fe640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca00b3e10 0x7fbca00ce960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000e980 tx=0x7fbc9000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9af0c05640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0702d0 0x7f9aec14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9af0c05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aec0728f0 0x7f9aec14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9af0c05640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aec15aa10 0x7f9aec14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9af0c05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0b4aa0 con 0x7f9aec0728f0 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9af0c05640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec0b4580 con 0x7f9aec15aa10 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9af0c05640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec14d0f0 con 0x7f9aec0702d0 2024-04-13T02:44:44.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd69259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd68c0501a0 0x7fd68c0d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c053c70 0x7fd68c0479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c053c70 0x7fd68c0479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52854/0 (socket says 172.21.15.114:52854) 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 -- 172.21.15.114:0/3563432445 learned_addr learned my addr 172.21.15.114:0/3563432445 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd692d9d640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd68c0df220 0x7fd68c04dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a8b24640 1 -- 172.21.15.114:0/2583809354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a415a9a0 msgr2=0x7f45a4167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a8b24640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45a415a9a0 0x7f45a4167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a8b24640 1 -- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40d09b0 msgr2=0x7f45a4151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a8b24640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a40d09b0 0x7f45a4151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9aead9d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aec15aa10 0x7f9aec14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9aea59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0702d0 0x7f9aec14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9aea59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0702d0 0x7f9aec14e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41184/0 (socket says 172.21.15.114:41184) 2024-04-13T02:44:44.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f9aea59c640 1 -- 172.21.15.114:0/1653975042 learned_addr learned my addr 172.21.15.114:0/1653975042 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7f45a8b24640 1 -- 172.21.15.114:0/2583809354 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a415d1b0 con 0x7f45a4069170 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec015070 con 0x7fc9fc145560 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc144100 con 0x7fc9fc145560 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec007b10 con 0x7fc9fc145560 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff454156870 con 0x7ff4540d00e0 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff44401a070 con 0x7ff4540d00e0 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9aea59c640 1 -- 172.21.15.114:0/1653975042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aec15aa10 msgr2=0x7f9aec14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9aea59c640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9aec15aa10 0x7f9aec14df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9aea59c640 1 -- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aec0728f0 msgr2=0x7f9aec14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9aea59c640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aec0728f0 0x7f9aec14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9aea59c640 1 -- 172.21.15.114:0/1653975042 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec14c850 con 0x7f9aec0702d0 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0f80f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f08072640 0x7f8f080b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90017070 con 0x7fbca00b3e10 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9000ca00 con 0x7fbca00b3e10 2024-04-13T02:44:44.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000cdd0 con 0x7fbca00b3e10 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec010470 con 0x7fc9fc145560 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc1446c0 con 0x7fc9fc145560 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 -- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd68c0501a0 msgr2=0x7fd68c0d9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd68c0501a0 0x7fd68c0d9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 -- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd68c0df220 msgr2=0x7fd68c04dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd68c0df220 0x7fd68c04dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.706+0000 7fd691d9b640 1 -- 172.21.15.114:0/3563432445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c0d9aa0 con 0x7fd68c053c70 2024-04-13T02:44:44.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0f80f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f080b4970 0x7f8f0815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fd691d9b640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c053c70 0x7fd68c0479b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd69402db70 tx=0x7fd69406dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69406bb40 con 0x7fd68c053c70 2024-04-13T02:44:44.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0f80f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f08162df0 0x7f8f0815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694090020 con 0x7fd68c053c70 2024-04-13T02:44:44.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0f80f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080b3650 con 0x7f8f08072640 2024-04-13T02:44:44.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9aea59c640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0702d0 0x7f9aec14e5b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007e40 tx=0x7f9ae400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0f80f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0806f770 con 0x7f8f080b4970 2024-04-13T02:44:44.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0f80f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8f080b38a0 con 0x7f8f08162df0 2024-04-13T02:44:44.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c0d9d70 con 0x7fd68c053c70 2024-04-13T02:44:44.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0d5ab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f08072640 0x7f8f080b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0ddac640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f08162df0 0x7f8f0815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0d5ab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f08072640 0x7f8f080b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52872/0 (socket says 172.21.15.114:52872) 2024-04-13T02:44:44.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f8f0d5ab640 1 -- 172.21.15.114:0/1951775918 learned_addr learned my addr 172.21.15.114:0/1951775918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:44.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9fc0ce5c0 con 0x7fc9fc145560 2024-04-13T02:44:44.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f8f0cdaa640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f080b4970 0x7f8f0815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f45a8b24640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a415cb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f459c02ba50 tx=0x7f459c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7ff4517fa640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff44006c9c0 0x7ff44006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff44408bd80 con 0x7ff4540d00e0 2024-04-13T02:44:44.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7fbca6174640 1 -- 172.21.15.114:0/848663285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca006ef60 con 0x7fbca00b3e10 2024-04-13T02:44:44.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7fbca6174640 1 -- 172.21.15.114:0/848663285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca0071780 con 0x7fbca00b3e10 2024-04-13T02:44:44.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c02f830 con 0x7f45a4069170 2024-04-13T02:44:44.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c046070 con 0x7f45a4069170 2024-04-13T02:44:44.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c041400 con 0x7f45a4069170 2024-04-13T02:44:44.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.707+0000 7f9d2b7fe640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d2404fda0 0x7f9d2404bb80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000e9e0 tx=0x7f9d2000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a415d490 con 0x7f45a4069170 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a4145400 con 0x7f45a4069170 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f8f0cdaa640 1 -- 172.21.15.114:0/1951775918 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f08162df0 msgr2=0x7f8f0815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f8f0cdaa640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f08162df0 0x7f8f0815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f8f0cdaa640 1 -- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f08072640 msgr2=0x7f8f080b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f8f0cdaa640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f08072640 0x7f8f080b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f8f0cdaa640 1 -- 172.21.15.114:0/1951775918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0815d8a0 con 0x7f8f080b4970 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f8f0cdaa640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f080b4970 0x7f8f0815cb70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8033000 tx=0x7f8ef80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9ec018070 con 0x7fc9fc145560 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4014620 con 0x7f9aec0702d0 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae4019070 con 0x7f9aec0702d0 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4014a00 con 0x7f9aec0702d0 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aec14cb30 con 0x7f9aec0702d0 2024-04-13T02:44:44.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aec15b500 con 0x7f9aec0702d0 2024-04-13T02:44:44.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9aec068c80 con 0x7f9aec0702d0 2024-04-13T02:44:44.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45a4068c80 con 0x7f45a4069170 2024-04-13T02:44:44.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8041070 con 0x7f8f080b4970 2024-04-13T02:44:44.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef803ab80 con 0x7f8f080b4970 2024-04-13T02:44:44.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8041070 con 0x7f8f080b4970 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7fc9f27fc640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc9e006c9c0 0x7fc9e006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc9ec08bc50 con 0x7fc9fc145560 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7fc9f27fc640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fc9e0074be0 0x7fc9e0077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 --> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9ec006870 con 0x7fc9e0074be0 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9ec0912a0 con 0x7fc9fc145560 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20017070 con 0x7f9d2404fda0 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2000c9d0 con 0x7f9d2404fda0 2024-04-13T02:44:44.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000cdc0 con 0x7f9d2404fda0 2024-04-13T02:44:44.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d240e57a0 con 0x7f9d2404fda0 2024-04-13T02:44:44.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d240e5d60 con 0x7f9d2404fda0 2024-04-13T02:44:44.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7f8f0f80f640 1 -- 172.21.15.114:0/1951775918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0815db80 con 0x7f8f080b4970 2024-04-13T02:44:44.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7ff4517fa640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7ff440074bc0 0x7ff440076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff44400ce90 con 0x7ff440074bc0 2024-04-13T02:44:44.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff444055e70 con 0x7ff4540d00e0 2024-04-13T02:44:44.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.708+0000 7ff4596bb640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7ff440074bc0 0x7ff440076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ae4014ba0 con 0x7f9aec0702d0 2024-04-13T02:44:44.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7ff4596bb640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7ff440074bc0 0x7ff440076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6940752e0 con 0x7fd68c053c70 2024-04-13T02:44:44.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.709+0000 7ff458eba640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff44006c9c0 0x7ff44006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd694075520 con 0x7fd68c053c70 2024-04-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7fca01f7c640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc9e006c9c0 0x7fc9e006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7fca0277d640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fc9e0074be0 0x7fc9e0077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.710+0000 7f8f0f80f640 1 -- 172.21.15.114:0/1951775918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0815e140 con 0x7f8f080b4970 2024-04-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c0da330 con 0x7fd68c053c70 2024-04-13T02:44:44.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9adaffd640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9acc06c8f0 0x7f9acc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7fca01f7c640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc9e006c9c0 0x7fc9e006ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9f403d000 tx=0x7fc9f4009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ae408c380 con 0x7f9aec0702d0 2024-04-13T02:44:44.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9adaffd640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7f9acc074a90 0x7f9acc076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 --> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ae400ce50 con 0x7f9acc074a90 2024-04-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9ae9d9b640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9acc06c8f0 0x7f9acc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== osd.0 v2:172.21.15.114:6810/2757198995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff44400ce90 con 0x7ff440074bc0 2024-04-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f080755c0 con 0x7f8f080b4970 2024-04-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9ae4093050 con 0x7f9aec0702d0 2024-04-13T02:44:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f459c040070 con 0x7f45a4069170 2024-04-13T02:44:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7ff458eba640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff44006c9c0 0x7ff44006ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff448009a20 tx=0x7ff448008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f9aead9d640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7f9acc074a90 0x7f9acc076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7fd682ffd640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd67406c9a0 0x7fd67406ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7f45a17fa640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f458406c9c0 0x7f458406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f459c0ae1d0 con 0x7f45a4069170 2024-04-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f45a17fa640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7f4584074be0 0x7f4584077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 --> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f459c038e90 con 0x7f4584074be0 2024-04-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f459c0ae5c0 con 0x7f45a4069170 2024-04-13T02:44:44.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f9aead9d640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7f9acc074a90 0x7f9acc076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f9ae9d9b640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9acc06c8f0 0x7f9acc06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0000f60 tx=0x7f9ae0007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fd69259c640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd67406c9a0 0x7fd67406ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd6940d1fc0 con 0x7fd68c053c70 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc9001a070 con 0x7fbca00b3e10 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.711+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbca0072ad0 con 0x7fbca00b3e10 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fbc87fff640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbc8c06c9f0 0x7fbc8c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbc9008b8a0 con 0x7fbca00b3e10 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fbc87fff640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7fbc8c074b90 0x7fbc8c076fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 --> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc8c077660 con 0x7fbc8c074b90 2024-04-13T02:44:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d2001a070 con 0x7f9d2404fda0 2024-04-13T02:44:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.712+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbc90092050 con 0x7fbca00b3e10 2024-04-13T02:44:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f45a3fff640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f458406c9c0 0x7f458406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fd69359e640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fd68c04e0f0 0x7fd68c0dade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 --> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd68c1829d0 con 0x7fd68c04e0f0 2024-04-13T02:44:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d240e5270 con 0x7f9d2404fda0 2024-04-13T02:44:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fbc9effd640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbc8c06c9f0 0x7fbc8c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d17fff640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9d1006c940 0x7f9d1006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f45a9325640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7f4584074be0 0x7f4584077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fbc9ffff640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7fbc8c074b90 0x7fbc8c076fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fd69259c640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd67406c9a0 0x7fd67406ee60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd688036000 tx=0x7fd688008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f45a9325640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7f4584074be0 0x7f4584077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d2affd640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9d1006c940 0x7f9d1006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9d2008bcd0 con 0x7f9d2404fda0 2024-04-13T02:44:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d17fff640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7f9d10074ae0 0x7f9d10076f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 --> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d100775b0 con 0x7f9d10074ae0 2024-04-13T02:44:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f45a3fff640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f458406c9c0 0x7f458406ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f45a414edb0 tx=0x7f458c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== osd.1 v2:172.21.15.114:6800/3111631753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ae400ce50 con 0x7f9acc074a90 2024-04-13T02:44:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fbc9effd640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbc8c06c9f0 0x7fbc8c06eeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc94006fd0 tx=0x7fbc94008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7fca0277d640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fc9e0074be0 0x7fc9e0077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.713+0000 7f9d2affd640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9d1006c940 0x7f9d1006ee00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d24053aa0 tx=0x7f9d2c0ab000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f9d2bfff640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7f9d10074ae0 0x7f9d10076f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7fd692d9d640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fd68c04e0f0 0x7fd68c0dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ef804c060 con 0x7f8f080b4970 2024-04-13T02:44:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9d20021050 con 0x7f9d2404fda0 2024-04-13T02:44:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7fbc9ffff640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7fbc8c074b90 0x7fbc8c076fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7fd692d9d640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fd68c04e0f0 0x7fd68c0dade0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f9d2bfff640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7f9d10074ae0 0x7f9d10076f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f8efdffb640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8eec06ccf0 0x7f8eec06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== osd.2 v2:172.21.15.114:6824/180657889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f459c038e90 con 0x7f4584074be0 2024-04-13T02:44:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ef803a980 con 0x7f8f080b4970 2024-04-13T02:44:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.714+0000 7f8f0d5ab640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8eec06ccf0 0x7f8eec06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f8efdffb640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f8eec074e90 0x7f8eec0772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ef800af30 con 0x7f8eec074e90 2024-04-13T02:44:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== osd.5 v2:172.21.15.130:6802/2468914972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9ec006870 con 0x7fc9e0074be0 2024-04-13T02:44:44.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8ef80ad410 con 0x7f8f080b4970 2024-04-13T02:44:44.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f8f0ddac640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f8eec074e90 0x7f8eec0772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:44.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== osd.4 v2:172.21.15.130:6800/3673343722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc8c077660 con 0x7fbc8c074b90 2024-04-13T02:44:44.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f8f0d5ab640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8eec06ccf0 0x7f8eec06f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009370 tx=0x7f8f04009300 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f8f0ddac640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f8eec074e90 0x7f8eec0772b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:44.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== osd.7 v2:172.21.15.130:6824/1928234772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d100775b0 con 0x7f9d10074ae0 2024-04-13T02:44:44.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.715+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== osd.6 v2:172.21.15.130:6816/576238142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd68c1829d0 con 0x7fd68c04e0f0 2024-04-13T02:44:44.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.716+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== osd.3 v2:172.21.15.114:6807/1156508834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ef800af30 con 0x7f8eec074e90 2024-04-13T02:44:44.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.744+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 --> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff454068c80 con 0x7ff440074bc0 2024-04-13T02:44:44.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.745+0000 7ff4517fa640 1 -- 172.21.15.114:0/1699368636 <== osd.0 v2:172.21.15.114:6810/2757198995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff454068c80 con 0x7ff440074bc0 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.745+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7ff440074bc0 msgr2=0x7ff440076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.745+0000 7ff43affd640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7ff440074bc0 0x7ff440076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.745+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff44006c9c0 msgr2=0x7ff44006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.746+0000 7ff43affd640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff44006c9c0 0x7ff44006ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff448009a20 tx=0x7ff448008040 comp rx=0 tx=0).stop 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.746+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4540d00e0 msgr2=0x7ff454161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.746+0000 7ff43affd640 1 --2- 172.21.15.114:0/1699368636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4540d00e0 0x7ff454161950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff44400e8d0 tx=0x7ff44400ed90 comp rx=0 tx=0).stop 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.746+0000 7ff4596bb640 1 -- 172.21.15.114:0/1699368636 reap_dead start 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 shutdown_connections 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 >> 172.21.15.114:0/1699368636 conn(0x7ff45406b930 msgr2=0x7ff45406fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 --> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9aec15af10 con 0x7f9acc074a90 2024-04-13T02:44:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 --> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45a415e3d0 con 0x7f4584074be0 2024-04-13T02:44:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 --> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd68c005390 con 0x7fd68c04e0f0 2024-04-13T02:44:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 shutdown_connections 2024-04-13T02:44:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7ff43affd640 1 -- 172.21.15.114:0/1699368636 wait complete. 2024-04-13T02:44:44.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 --> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbca0071980 con 0x7fbc8c074b90 2024-04-13T02:44:44.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7fd682ffd640 1 -- 172.21.15.114:0/3563432445 <== osd.6 v2:172.21.15.130:6816/576238142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd68c005390 con 0x7fd68c04e0f0 2024-04-13T02:44:44.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7f9adaffd640 1 -- 172.21.15.114:0/1653975042 <== osd.1 v2:172.21.15.114:6800/3111631753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9aec15af10 con 0x7f9acc074a90 2024-04-13T02:44:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7f45a17fa640 1 -- 172.21.15.114:0/2583809354 <== osd.2 v2:172.21.15.114:6824/180657889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45a415e3d0 con 0x7f4584074be0 2024-04-13T02:44:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.747+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 --> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9fc068c80 con 0x7fc9e0074be0 2024-04-13T02:44:44.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc87fff640 1 -- 172.21.15.114:0/848663285 <== osd.4 v2:172.21.15.130:6800/3673343722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbca0071980 con 0x7fbc8c074b90 2024-04-13T02:44:44.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fd68c04e0f0 msgr2=0x7fd68c0dade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fd68c04e0f0 0x7fd68c0dade0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7f9acc074a90 msgr2=0x7f9acc076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fc9f27fc640 1 -- 172.21.15.114:0/3445246325 <== osd.5 v2:172.21.15.130:6802/2468914972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc9fc068c80 con 0x7fc9e0074be0 2024-04-13T02:44:44.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7f4584074be0 msgr2=0x7f4584077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45aad88640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7f4584074be0 0x7f4584077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd67406c9a0 msgr2=0x7fd67406ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd67406c9a0 0x7fd67406ee60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd688036000 tx=0x7fd688008030 comp rx=0 tx=0).stop 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c053c70 msgr2=0x7fd68c0479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 --2- 172.21.15.114:0/3563432445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c053c70 0x7fd68c0479b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd69402db70 tx=0x7fd69406dd20 comp rx=0 tx=0).stop 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd692d9d640 1 -- 172.21.15.114:0/3563432445 reap_dead start 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 shutdown_connections 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 >> 172.21.15.114:0/3563432445 conn(0x7fd68c009fb0 msgr2=0x7fd68c0df9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f458406c9c0 msgr2=0x7f458406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7fbc8c074b90 msgr2=0x7fbc8c076fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc85ffb640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7fbc8c074b90 0x7fbc8c076fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45aad88640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f458406c9c0 0x7f458406ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f45a414edb0 tx=0x7f458c009190 comp rx=0 tx=0).stop 2024-04-13T02:44:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbc8c06c9f0 msgr2=0x7fbc8c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 msgr2=0x7f45a415cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc85ffb640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbc8c06c9f0 0x7fbc8c06eeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc94006fd0 tx=0x7fbc94008040 comp rx=0 tx=0).stop 2024-04-13T02:44:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45aad88640 1 --2- 172.21.15.114:0/2583809354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45a4069170 0x7f45a415cb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f459c02ba50 tx=0x7f459c004730 comp rx=0 tx=0).stop 2024-04-13T02:44:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca00b3e10 msgr2=0x7fbca00ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f45a9325640 1 -- 172.21.15.114:0/2583809354 reap_dead start 2024-04-13T02:44:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc85ffb640 1 --2- 172.21.15.114:0/848663285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbca00b3e10 0x7fbca00ce960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000e980 tx=0x7fbc9000ee40 comp rx=0 tx=0).stop 2024-04-13T02:44:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7fbc9ffff640 1 -- 172.21.15.114:0/848663285 reap_dead start 2024-04-13T02:44:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 shutdown_connections 2024-04-13T02:44:44.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.748+0000 7f9af0c05640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7f9acc074a90 0x7f9acc076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 >> 172.21.15.114:0/848663285 conn(0x7fbca006d5f0 msgr2=0x7fbca0165ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 shutdown_connections 2024-04-13T02:44:44.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 >> 172.21.15.114:0/2583809354 conn(0x7f45a40b2bd0 msgr2=0x7f45a415e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fc9e0074be0 msgr2=0x7fc9e0077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 shutdown_connections 2024-04-13T02:44:44.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fc9e0074be0 0x7fc9e0077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 shutdown_connections 2024-04-13T02:44:44.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f45aad88640 1 -- 172.21.15.114:0/2583809354 wait complete. 2024-04-13T02:44:44.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fd69359e640 1 -- 172.21.15.114:0/3563432445 wait complete. 2024-04-13T02:44:44.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 shutdown_connections 2024-04-13T02:44:44.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fbc85ffb640 1 -- 172.21.15.114:0/848663285 wait complete. 2024-04-13T02:44:44.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc9e006c9c0 msgr2=0x7fc9e006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9acc06c8f0 msgr2=0x7f9acc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9af0c05640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9acc06c8f0 0x7f9acc06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0000f60 tx=0x7f9ae0007990 comp rx=0 tx=0).stop 2024-04-13T02:44:44.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0702d0 msgr2=0x7f9aec14e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9af0c05640 1 --2- 172.21.15.114:0/1653975042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9aec0702d0 0x7f9aec14e5b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007e40 tx=0x7f9ae400e4b0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc9e006c9c0 0x7fc9e006ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9f403d000 tx=0x7fc9f4009000 comp rx=0 tx=0).stop 2024-04-13T02:44:44.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9aead9d640 1 -- 172.21.15.114:0/1653975042 reap_dead start 2024-04-13T02:44:44.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f08161870 con 0x7f8eec074e90 2024-04-13T02:44:44.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc145560 msgr2=0x7fc9fc143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 shutdown_connections 2024-04-13T02:44:44.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 >> 172.21.15.114:0/1653975042 conn(0x7f9aec0b27b0 msgr2=0x7f9aec159010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 --2- 172.21.15.114:0/3445246325 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9fc145560 0x7fc9fc143630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00d990 tx=0x7fc9ec00dd90 comp rx=0 tx=0).stop 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca0277d640 1 -- 172.21.15.114:0/3445246325 reap_dead start 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 shutdown_connections 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 >> 172.21.15.114:0/3445246325 conn(0x7fc9fc09aa40 msgr2=0x7fc9fc06ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 shutdown_connections 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.749+0000 7fca041e0640 1 -- 172.21.15.114:0/3445246325 wait complete. 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.750+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 shutdown_connections 2024-04-13T02:44:44.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.750+0000 7f9af0c05640 1 -- 172.21.15.114:0/1653975042 wait complete. 2024-04-13T02:44:44.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.750+0000 7f8efdffb640 1 -- 172.21.15.114:0/1951775918 <== osd.3 v2:172.21.15.114:6807/1156508834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8f08161870 con 0x7f8eec074e90 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.750+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f8eec074e90 msgr2=0x7f8eec0772b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f8eec074e90 0x7f8eec0772b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8eec06ccf0 msgr2=0x7f8eec06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8eec06ccf0 0x7f8eec06f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009370 tx=0x7f8f04009300 comp rx=0 tx=0).stop 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f080b4970 msgr2=0x7f8f0815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 --2- 172.21.15.114:0/1951775918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f080b4970 0x7f8f0815cb70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8033000 tx=0x7f8ef80046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8f0ddac640 1 -- 172.21.15.114:0/1951775918 reap_dead start 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 shutdown_connections 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 >> 172.21.15.114:0/1951775918 conn(0x7f8f0806b930 msgr2=0x7f8f0806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 shutdown_connections 2024-04-13T02:44:44.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f8eeb7fe640 1 -- 172.21.15.114:0/1951775918 wait complete. 2024-04-13T02:44:44.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.751+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 --> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d24005380 con 0x7f9d10074ae0 2024-04-13T02:44:44.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.752+0000 7f9d17fff640 1 -- 172.21.15.114:0/1253086433 <== osd.7 v2:172.21.15.130:6824/1928234772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d24005380 con 0x7f9d10074ae0 2024-04-13T02:44:44.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.754+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7f9d10074ae0 msgr2=0x7f9d10076f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.754+0000 7f9d32236640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7f9d10074ae0 0x7f9d10076f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.754+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9d1006c940 msgr2=0x7f9d1006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.754+0000 7f9d32236640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9d1006c940 0x7f9d1006ee00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d24053aa0 tx=0x7f9d2c0ab000 comp rx=0 tx=0).stop 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.754+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d2404fda0 msgr2=0x7f9d2404bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.755+0000 7f9d32236640 1 --2- 172.21.15.114:0/1253086433 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d2404fda0 0x7f9d2404bb80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000e9e0 tx=0x7f9d2000eea0 comp rx=0 tx=0).stop 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.755+0000 7f9d2bfff640 1 -- 172.21.15.114:0/1253086433 reap_dead start 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.755+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 shutdown_connections 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.755+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 >> 172.21.15.114:0/1253086433 conn(0x7f9d24009fa0 msgr2=0x7f9d24039880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.758+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 shutdown_connections 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:44.758+0000 7f9d32236640 1 -- 172.21.15.114:0/1253086433 wait complete. 2024-04-13T02:44:44.823 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:44.824 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:44.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-13T02:44:44.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-13T02:44:44.826 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:44.826 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-13T02:44:44.827 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:44.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-13T02:44:44.828 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-13T02:44:44.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-13T02:44:44.829 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:44.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-13T02:44:44.830 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:44.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-13T02:44:44.832 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:44.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-13T02:44:45.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.032+0000 7f50c231e640 1 Processor -- start 2024-04-13T02:44:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.033+0000 7f50c231e640 1 -- start start 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50c231e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50bc070640 0x7f50bc0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50c231e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50bc072100 0x7f50bc15a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50c231e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50bc0cef40 con 0x7f50bc0ceaa0 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50c231e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f50bc15ae50 con 0x7f50bc072100 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50c231e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f50bc0cf220 con 0x7f50bc070640 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50bb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50bc070640 0x7f50bc0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f7a351f7640 1 Processor -- start 2024-04-13T02:44:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f7a351f7640 1 -- start start 2024-04-13T02:44:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50bb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50bc070640 0x7f50bc0cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59604/0 (socket says 172.21.15.114:59604) 2024-04-13T02:44:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7f50bb7fe640 1 -- 172.21.15.114:0/1875983586 learned_addr learned my addr 172.21.15.114:0/1875983586 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.033+0000 7fbc01a66640 1 Processor -- start 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.033+0000 7fbc01a66640 1 -- start start 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc01a66640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16efd0 0x7fbbfc0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc01a66640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbbfc06f4d0 0x7fbbfc06f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc01a66640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbfc16ed60 con 0x7fbbfc16e980 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc01a66640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbbfc0b36f0 con 0x7fbbfc06f4d0 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc01a66640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbbfc16f460 con 0x7fbbfc16efd0 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc00a64640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbbfc16e980 0x7fbbfc0b4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58900/0 (socket says 172.21.15.114:58900) 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.034+0000 7fbc00a64640 1 -- 172.21.15.114:0/1437809602 learned_addr learned my addr 172.21.15.114:0/1437809602 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbc01265640 1 --2- 172.21.15.114:0/1437809602 >> v2:172.21.15.114:3300/0 conn(0x7fbbfc06f4d0 0x7fbbfc06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f50c08bb640 1 --2- 172.21.15.114:0/1875983586 >> v2:172.21.15.114:3300/0 conn(0x7f50bc072100 0x7f50bc15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbbfbfff640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16efd0 0x7fbbfc0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbc01265640 1 -- 172.21.15.114:0/1437809602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16efd0 msgr2=0x7fbbfc0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbc01265640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16efd0 0x7fbbfc0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbc01265640 1 -- 172.21.15.114:0/1437809602 >> v1:172.21.15.114:6789/0 conn(0x7fbbfc16e980 legacy=0x7fbbfc0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbc01265640 1 -- 172.21.15.114:0/1437809602 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc16f740 con 0x7fbbfc06f4d0 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7fbbfbfff640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16efd0 0x7fbbfc0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f50bb7fe640 1 -- 172.21.15.114:0/1875983586 >> v2:172.21.15.114:3300/0 conn(0x7f50bc072100 msgr2=0x7f50bc15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f50bb7fe640 1 --2- 172.21.15.114:0/1875983586 >> v2:172.21.15.114:3300/0 conn(0x7f50bc072100 0x7f50bc15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f50bb7fe640 1 -- 172.21.15.114:0/1875983586 >> v1:172.21.15.130:6789/0 conn(0x7f50bc0ceaa0 legacy=0x7f50bc06ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f50bb7fe640 1 -- 172.21.15.114:0/1875983586 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc0cf500 con 0x7f50bc070640 2024-04-13T02:44:45.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f7a351f7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a281051e0 0x7f7a2804f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f7a351f7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a28054010 0x7f7a28054460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a351f7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a28052fd0 con 0x7f7a28037c20 2024-04-13T02:44:45.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a351f7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2804f7d0 con 0x7f7a28054010 2024-04-13T02:44:45.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a351f7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7a28053270 con 0x7f7a281051e0 2024-04-13T02:44:45.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f5998288640 1 Processor -- start 2024-04-13T02:44:45.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.035+0000 7f8673280640 1 Processor -- start 2024-04-13T02:44:45.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f8673280640 1 -- start start 2024-04-13T02:44:45.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f50bb7fe640 1 --2- 172.21.15.114:0/1875983586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc070640 0x7f50bc0cffe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b5bb0 tx=0x7f50ac02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9189d5d21a44a588 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f50baffd640 1 -- 172.21.15.114:0/1875983586 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac02e070 con 0x7f50bc070640 2024-04-13T02:44:45.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f50baffd640 1 -- 172.21.15.114:0/1875983586 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac037070 con 0x7f50bc070640 2024-04-13T02:44:45.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5bc4faa640 1 Processor -- start 2024-04-13T02:44:45.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f50baffd640 1 -- 172.21.15.114:0/1875983586 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac031a00 con 0x7f50bc070640 2024-04-13T02:44:45.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5bc4faa640 1 -- start start 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a28054010 0x7f7a28054460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a28054010 0x7f7a28054460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52904/0 (socket says 172.21.15.114:52904) 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 -- 172.21.15.114:0/3478908283 learned_addr learned my addr 172.21.15.114:0/3478908283 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 -- 172.21.15.114:0/3478908283 >> v2:172.21.15.130:3300/0 conn(0x7f7a281051e0 msgr2=0x7f7a2804f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 --2- 172.21.15.114:0/3478908283 >> v2:172.21.15.130:3300/0 conn(0x7f7a281051e0 0x7f7a2804f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 -- 172.21.15.114:0/3478908283 >> v1:172.21.15.130:6789/0 conn(0x7f7a28037c20 legacy=0x7f7a28038070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f7a2e59c640 1 -- 172.21.15.114:0/3478908283 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a28053530 con 0x7f7a28054010 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f8673280640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86640eb060 0x7f8664055300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f8673280640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f86640eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.036+0000 7f5998288640 1 -- start start 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5998288640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f59900b0510 0x7f599006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5998288640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f599006ce80 0x7f59900b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5998288640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5990144ac0 con 0x7f59901446e0 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5998288640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f599015b260 con 0x7f59900b0510 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5998288640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f599006f410 con 0x7f599006ce80 2024-04-13T02:44:45.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f8673280640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86640387e0 con 0x7f86640e7a70 2024-04-13T02:44:45.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f8673280640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8664057e30 con 0x7f86640eb060 2024-04-13T02:44:45.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f8673280640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f86640579a0 con 0x7f86640eb440 2024-04-13T02:44:45.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7feb90e26640 1 Processor -- start 2024-04-13T02:44:45.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f261ae26640 1 Processor -- start 2024-04-13T02:44:45.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5995823640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f59900b0510 0x7f599006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f50c231e640 1 -- 172.21.15.114:0/1875983586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc070640 msgr2=0x7f50bc0cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f50c231e640 1 --2- 172.21.15.114:0/1875983586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc070640 0x7f50bc0cffe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b5bb0 tx=0x7f50ac02b880 comp rx=0 tx=0).stop 2024-04-13T02:44:45.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5996024640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f59901446e0 0x7f59900b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47688/0 (socket says 172.21.15.114:47688) 2024-04-13T02:44:45.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5996024640 1 -- 172.21.15.114:0/3519233582 learned_addr learned my addr 172.21.15.114:0/3519233582 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:45.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f5996825640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f599006ce80 0x7f59900b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f867081b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f86640eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f867081b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f86640eb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41216/0 (socket says 172.21.15.114:41216) 2024-04-13T02:44:45.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.037+0000 7f867081b640 1 -- 172.21.15.114:0/3664794999 learned_addr learned my addr 172.21.15.114:0/3664794999 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f7a2e59c640 1 --2- 172.21.15.114:0/3478908283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a28054010 0x7f7a28054460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002db70 tx=0x7f7a300967f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0012870d82d988 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f50c231e640 1 -- 172.21.15.114:0/1875983586 shutdown_connections 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f50c231e640 1 --2- 172.21.15.114:0/1875983586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc070640 0x7f50bc0cffe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f50c231e640 1 --2- 172.21.15.114:0/1875983586 >> v2:172.21.15.114:3300/0 conn(0x7f50bc072100 0x7f50bc15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f50c231e640 1 -- 172.21.15.114:0/1875983586 >> 172.21.15.114:0/1875983586 conn(0x7f50bc0b28b0 msgr2=0x7f50bc0b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f50c231e640 1 -- 172.21.15.114:0/1875983586 shutdown_connections 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f50c231e640 1 -- 172.21.15.114:0/1875983586 wait complete. 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7feb90e26640 1 -- start start 2024-04-13T02:44:45.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f7a2dd9b640 1 -- 172.21.15.114:0/3478908283 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300a3070 con 0x7f7a28054010 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f7a2dd9b640 1 -- 172.21.15.114:0/3478908283 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3009a050 con 0x7f7a28054010 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f7a2dd9b640 1 -- 172.21.15.114:0/3478908283 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3009e9a0 con 0x7f7a28054010 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f867081b640 1 -- 172.21.15.114:0/3664794999 >> v2:172.21.15.114:3300/0 conn(0x7f86640eb060 msgr2=0x7f8664055300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f867081b640 1 --2- 172.21.15.114:0/3664794999 >> v2:172.21.15.114:3300/0 conn(0x7f86640eb060 0x7f8664055300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f867081b640 1 -- 172.21.15.114:0/3664794999 >> v1:172.21.15.114:6789/0 conn(0x7f86640e7a70 legacy=0x7f86640e7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f867081b640 1 -- 172.21.15.114:0/3664794999 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664056d90 con 0x7f86640eb440 2024-04-13T02:44:45.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f261ae26640 1 -- start start 2024-04-13T02:44:45.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5995823640 1 -- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f599006ce80 msgr2=0x7f59900b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5995823640 1 --2- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f599006ce80 0x7f59900b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5995823640 1 -- 172.21.15.114:0/3519233582 >> v1:172.21.15.130:6789/0 conn(0x7f59901446e0 legacy=0x7f59900b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5995022640 1 -- 172.21.15.114:0/3519233582 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635620224 0 0) 0x7f5990144ac0 con 0x7f59901446e0 2024-04-13T02:44:45.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5995823640 1 -- 172.21.15.114:0/3519233582 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599006e800 con 0x7f59900b0510 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5bc4faa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5bc009b500 0x7f5bc00d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5bc4faa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc009baa0 con 0x7f5bc00d0f60 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5bc4faa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc009bd80 con 0x7f5bc015ff50 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7f5bc4faa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5bc009c060 con 0x7f5bc009b500 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbe59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5bc015ff50 0x7f5bc00d0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47690/0 (socket says 172.21.15.114:47690) 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbe59c640 1 -- 172.21.15.114:0/2532034510 learned_addr learned my addr 172.21.15.114:0/2532034510 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/2532034510 >> v2:172.21.15.114:3300/0 conn(0x7f5bc009b500 0x7f5bc00d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f261ae26640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2614162db0 0x7f26140d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f867081b640 1 --2- 172.21.15.114:0/3664794999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f86640eb8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f865c009870 tx=0x7f865c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efcfb5a89c038454 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb90e26640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb90e26640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb8404ffd0 0x7feb84037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb90e26640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7feb84038110 0x7feb840385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb90e26640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7feb84054330 con 0x7feb8404ffd0 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb90e26640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7feb84053720 con 0x7feb84038110 2024-04-13T02:44:45.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb90e26640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7feb84053a00 con 0x7feb840ead00 2024-04-13T02:44:45.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f261ae26640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2614166840 0x7f26140d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f261ae26640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2614166db0 con 0x7f26140d32a0 2024-04-13T02:44:45.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f261ae26640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f26140d2390 con 0x7f2614166840 2024-04-13T02:44:45.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f261ae26640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2614167090 con 0x7f2614162db0 2024-04-13T02:44:45.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb8affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb8404ffd0 0x7feb84037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f2619623640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2614166840 0x7f26140d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f2619623640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2614166840 0x7f26140d2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52946/0 (socket says 172.21.15.114:52946) 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f2619623640 1 -- 172.21.15.114:0/1402897144 learned_addr learned my addr 172.21.15.114:0/1402897144 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb8affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb8404ffd0 0x7feb84037bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52932/0 (socket says 172.21.15.114:52932) 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7feb8affd640 1 -- 172.21.15.114:0/4203765619 learned_addr learned my addr 172.21.15.114:0/4203765619 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994173534 0 0) 0x7f5bc009bd80 con 0x7f5bc015ff50 2024-04-13T02:44:45.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ba8003520 con 0x7f5bc015ff50 2024-04-13T02:44:45.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4139644086 0 0) 0x7f5ba8003520 con 0x7f5bc015ff50 2024-04-13T02:44:45.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 >> v2:172.21.15.114:3300/0 conn(0x7f5bc009b500 msgr2=0x7f5bc00d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f50c231e640 1 Processor -- start 2024-04-13T02:44:45.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.039+0000 7f2619e24640 1 --2- 172.21.15.114:0/1402897144 >> v2:172.21.15.130:3300/0 conn(0x7f2614162db0 0x7f26140d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8bfff640 1 --2- 172.21.15.114:0/4203765619 >> v2:172.21.15.130:3300/0 conn(0x7feb84038110 0x7feb840385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 --2- 172.21.15.114:0/2532034510 >> v2:172.21.15.114:3300/0 conn(0x7f5bc009b500 0x7f5bc00d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 >> v1:172.21.15.114:6789/0 conn(0x7f5bc00d0f60 legacy=0x7f5bc0070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc00704d0 con 0x7f5bc015ff50 2024-04-13T02:44:45.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7fbc01265640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc06f980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4007630 tx=0x7fbbf402dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e608b9a0f586c9a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f5bb0001650 con 0x7f5bc015ff50 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 >> v1:172.21.15.130:6789/0 conn(0x7f5bc015ff50 legacy=0x7f5bc00d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ba80039d0 0x7f5ba8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ba8004800 0x7f5ba8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5ba80145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc009c060 con 0x7f5ba8004800 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8014b00 con 0x7f5ba80039d0 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7fbbfb7fe640 1 -- 172.21.15.114:0/1437809602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4034070 con 0x7fbbfc06f4d0 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.038+0000 7fbbfb7fe640 1 -- 172.21.15.114:0/1437809602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf402eda0 con 0x7fbbfc06f4d0 2024-04-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba8014c80 con 0x7f5ba80052e0 2024-04-13T02:44:45.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbbfb7fe640 1 -- 172.21.15.114:0/1437809602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4038620 con 0x7fbbfc06f4d0 2024-04-13T02:44:45.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/2532034510 >> v2:172.21.15.114:3300/0 conn(0x7f5bc009b500 0x7f5bc00d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:45.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f2619623640 1 -- 172.21.15.114:0/1402897144 >> v2:172.21.15.130:3300/0 conn(0x7f2614162db0 msgr2=0x7f26140d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f2619623640 1 --2- 172.21.15.114:0/1402897144 >> v2:172.21.15.130:3300/0 conn(0x7f2614162db0 0x7f26140d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f2619623640 1 -- 172.21.15.114:0/1402897144 >> v1:172.21.15.130:6789/0 conn(0x7f26140d32a0 legacy=0x7f26140b61b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f2619623640 1 -- 172.21.15.114:0/1402897144 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2614167370 con 0x7f2614166840 2024-04-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5995823640 1 --2- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59900b0510 0x7f599006c940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5988009d90 tx=0x7f598802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66e0c38741084bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 -- 172.21.15.114:0/1437809602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 msgr2=0x7fbbfc06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc06f980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4007630 tx=0x7fbbf402dff0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 -- 172.21.15.114:0/1437809602 shutdown_connections 2024-04-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc06f980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 --2- 172.21.15.114:0/1437809602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16efd0 0x7fbbfc0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5ba80145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 -- 172.21.15.114:0/1437809602 >> 172.21.15.114:0/1437809602 conn(0x7fbbfc067b40 msgr2=0x7fbbfc06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f7a351f7640 1 -- 172.21.15.114:0/3478908283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a28054010 msgr2=0x7f7a28054460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f7a351f7640 1 --2- 172.21.15.114:0/3478908283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a28054010 0x7f7a28054460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002db70 tx=0x7f7a300967f0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f8663fff640 1 -- 172.21.15.114:0/3664794999 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c0317c0 con 0x7f86640eb440 2024-04-13T02:44:45.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f8663fff640 1 -- 172.21.15.114:0/3664794999 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865c037070 con 0x7f86640eb440 2024-04-13T02:44:45.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f8663fff640 1 -- 172.21.15.114:0/3664794999 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c031b80 con 0x7f86640eb440 2024-04-13T02:44:45.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8b7fe640 1 --2- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f7a351f7640 1 -- 172.21.15.114:0/3478908283 shutdown_connections 2024-04-13T02:44:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f7a351f7640 1 --2- 172.21.15.114:0/3478908283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a28054010 0x7f7a28054460 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002db70 tx=0x7f7a300967f0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f7a351f7640 1 --2- 172.21.15.114:0/3478908283 >> v2:172.21.15.130:3300/0 conn(0x7f7a281051e0 0x7f7a2804f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f7a351f7640 1 -- 172.21.15.114:0/3478908283 >> 172.21.15.114:0/3478908283 conn(0x7f7a28009fb0 msgr2=0x7f7a2800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5995022640 1 -- 172.21.15.114:0/3519233582 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988039070 con 0x7f59900b0510 2024-04-13T02:44:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbe59c640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ba80039d0 0x7f5ba8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5995022640 1 -- 172.21.15.114:0/3519233582 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598802cc80 con 0x7f59900b0510 2024-04-13T02:44:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5995022640 1 -- 172.21.15.114:0/3519233582 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988034660 con 0x7f59900b0510 2024-04-13T02:44:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 -- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ba80039d0 msgr2=0x7f5ba8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ba80039d0 0x7f5ba8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 -- 172.21.15.114:0/2532034510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ba8004800 msgr2=0x7f5ba8004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-13T02:44:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ba8004800 0x7f5ba8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f5bbed9d640 1 -- 172.21.15.114:0/2532034510 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc00704d0 con 0x7f5ba80052e0 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8bfff640 1 -- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 msgr2=0x7feb8404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8bfff640 1 --2- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8404fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8bfff640 1 -- 172.21.15.114:0/4203765619 >> v2:172.21.15.114:3300/0 conn(0x7feb8404ffd0 msgr2=0x7feb84037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8bfff640 1 --2- 172.21.15.114:0/4203765619 >> v2:172.21.15.114:3300/0 conn(0x7feb8404ffd0 0x7feb84037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7feb8bfff640 1 -- 172.21.15.114:0/4203765619 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84053ce0 con 0x7feb84038110 2024-04-13T02:44:45.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7f50c231e640 1 -- start start 2024-04-13T02:44:45.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 -- 172.21.15.114:0/1437809602 shutdown_connections 2024-04-13T02:44:45.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.040+0000 7fbc01a66640 1 -- 172.21.15.114:0/1437809602 wait complete. 2024-04-13T02:44:45.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c231e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 0x7f50bc204c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c231e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50bc072100 0x7f50bc1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 0x7f50bc204c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c231e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc0ceaa0 0x7f50bc06b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c231e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc06f8a0 con 0x7f50bc070640 2024-04-13T02:44:45.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f2619623640 1 --2- 172.21.15.114:0/1402897144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2614166840 0x7f26140d2d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f26140b72a0 tx=0x7f260402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fca0226ef9ad9d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 0x7f50bc204c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52954/0 (socket says 172.21.15.114:52954) 2024-04-13T02:44:45.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50bbfff640 1 -- 172.21.15.114:0/1332439058 learned_addr learned my addr 172.21.15.114:0/1332439058 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc0cfac0 con 0x7f50bc0ceaa0 2024-04-13T02:44:45.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f2618e22640 1 -- 172.21.15.114:0/1402897144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604035020 con 0x7f2614166840 2024-04-13T02:44:45.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f50bc06fa20 con 0x7f50bc072100 2024-04-13T02:44:45.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f5bbed9d640 1 -- 172.21.15.114:0/2532034510 reap_dead start 2024-04-13T02:44:45.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f8673280640 1 -- 172.21.15.114:0/3664794999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 msgr2=0x7f86640eb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f8673280640 1 --2- 172.21.15.114:0/3664794999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f86640eb8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f865c009870 tx=0x7f865c02b860 comp rx=0 tx=0).stop 2024-04-13T02:44:45.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f50c08bb640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc0ceaa0 0x7f50bc06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f2618e22640 1 -- 172.21.15.114:0/1402897144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2604031870 con 0x7f2614166840 2024-04-13T02:44:45.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.041+0000 7f2618e22640 1 -- 172.21.15.114:0/1402897144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604031c40 con 0x7f2614166840 2024-04-13T02:44:45.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7feb8bfff640 1 --2- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb84038110 0x7feb840385a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb8c050b00 tx=0x7feb8c0a74d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667c3cc7330517e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5ba80145c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80073e0 tx=0x7f5ba8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d831873fd96a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f8673280640 1 -- 172.21.15.114:0/3664794999 shutdown_connections 2024-04-13T02:44:45.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f8673280640 1 --2- 172.21.15.114:0/3664794999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f86640eb8c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f8673280640 1 --2- 172.21.15.114:0/3664794999 >> v2:172.21.15.114:3300/0 conn(0x7f86640eb060 0x7f8664055300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f8673280640 1 -- 172.21.15.114:0/3664794999 >> 172.21.15.114:0/3664794999 conn(0x7f86640559e0 msgr2=0x7f8664055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bb7fe640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50bc072100 0x7f50bc1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f5998288640 1 -- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59900b0510 msgr2=0x7f599006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f5998288640 1 --2- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59900b0510 0x7f599006c940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5988009d90 tx=0x7f598802bed0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f7a351f7640 1 -- 172.21.15.114:0/3478908283 shutdown_connections 2024-04-13T02:44:45.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f7a351f7640 1 -- 172.21.15.114:0/3478908283 wait complete. 2024-04-13T02:44:45.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7feb8a7fc640 1 -- 172.21.15.114:0/4203765619 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0b3070 con 0x7feb84038110 2024-04-13T02:44:45.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7feb8a7fc640 1 -- 172.21.15.114:0/4203765619 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c0ac870 con 0x7feb84038110 2024-04-13T02:44:45.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7feb8a7fc640 1 -- 172.21.15.114:0/4203765619 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0acce0 con 0x7feb84038110 2024-04-13T02:44:45.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bbfff640 1 -- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50bc072100 msgr2=0x7f50bc1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bbfff640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50bc072100 0x7f50bc1488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bbfff640 1 -- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc0ceaa0 msgr2=0x7f50bc06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bbfff640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc0ceaa0 0x7f50bc06b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8039070 con 0x7f5ba80052e0 2024-04-13T02:44:45.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb802ce00 con 0x7f5ba80052e0 2024-04-13T02:44:45.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f5bbd59a640 1 -- 172.21.15.114:0/2532034510 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8009c80 con 0x7f5ba80052e0 2024-04-13T02:44:45.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bbfff640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc148de0 con 0x7f50bc070640 2024-04-13T02:44:45.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bb7fe640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50bc072100 0x7f50bc1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:45.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f50bbfff640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 0x7f50bc204c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50b400ba50 tx=0x7f50b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f8673280640 1 -- 172.21.15.114:0/3664794999 shutdown_connections 2024-04-13T02:44:45.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f8673280640 1 -- 172.21.15.114:0/3664794999 wait complete. 2024-04-13T02:44:45.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f261ae26640 1 -- 172.21.15.114:0/1402897144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2614166840 msgr2=0x7f26140d2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7f261ae26640 1 --2- 172.21.15.114:0/1402897144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2614166840 0x7f26140d2d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f26140b72a0 tx=0x7f260402b910 comp rx=0 tx=0).stop 2024-04-13T02:44:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4019070 con 0x7f50bc070640 2024-04-13T02:44:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b400cc20 con 0x7f50bc070640 2024-04-13T02:44:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4014680 con 0x7f50bc070640 2024-04-13T02:44:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc15bf80 con 0x7f50bc070640 2024-04-13T02:44:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc205650 con 0x7f50bc070640 2024-04-13T02:44:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 -- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 msgr2=0x7f5ba80145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5ba80145c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80073e0 tx=0x7f5ba8005830 comp rx=0 tx=0).stop 2024-04-13T02:44:45.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7feb90e26640 1 -- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb84038110 msgr2=0x7feb840385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7feb90e26640 1 --2- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb84038110 0x7feb840385a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb8c050b00 tx=0x7feb8c0a74d0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7fbc01a66640 1 Processor -- start 2024-04-13T02:44:45.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.042+0000 7fbc01a66640 1 -- start start 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 -- 172.21.15.114:0/2532034510 shutdown_connections 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/2532034510 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5ba80145c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 -- 172.21.15.114:0/2532034510 >> 172.21.15.114:0/2532034510 conn(0x7f5bc00d26c0 msgr2=0x7f5bc00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 -- 172.21.15.114:0/2532034510 shutdown_connections 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f261ae26640 1 -- 172.21.15.114:0/1402897144 shutdown_connections 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f261ae26640 1 --2- 172.21.15.114:0/1402897144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2614166840 0x7f26140d2d60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f261ae26640 1 --2- 172.21.15.114:0/1402897144 >> v2:172.21.15.130:3300/0 conn(0x7f2614162db0 0x7f26140d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f261ae26640 1 -- 172.21.15.114:0/1402897144 >> 172.21.15.114:0/1402897144 conn(0x7f261406d3d0 msgr2=0x7f2614073060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5998288640 1 -- 172.21.15.114:0/3519233582 shutdown_connections 2024-04-13T02:44:45.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5998288640 1 --2- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f599006ce80 0x7f59900b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5998288640 1 --2- 172.21.15.114:0/3519233582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59900b0510 0x7f599006c940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5998288640 1 -- 172.21.15.114:0/3519233582 >> 172.21.15.114:0/3519233582 conn(0x7f59900728c0 msgr2=0x7f5990072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7f261ae26640 1 -- 172.21.15.114:0/1402897144 shutdown_connections 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 -- 172.21.15.114:0/4203765619 shutdown_connections 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 --2- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb84038110 0x7feb840385a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 --2- 172.21.15.114:0/4203765619 >> v2:172.21.15.114:3300/0 conn(0x7feb8404ffd0 0x7feb84037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 --2- 172.21.15.114:0/4203765619 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8404fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 -- 172.21.15.114:0/4203765619 >> 172.21.15.114:0/4203765619 conn(0x7feb84009fb0 msgr2=0x7feb8400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 -- 172.21.15.114:0/4203765619 shutdown_connections 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7feb90e26640 1 -- 172.21.15.114:0/4203765619 wait complete. 2024-04-13T02:44:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7f261ae26640 1 -- 172.21.15.114:0/1402897144 wait complete. 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7fbc01a66640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc1661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc00a64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc1661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc00a64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc1661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52958/0 (socket says 172.21.15.114:52958) 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc01a66640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbfc16e980 0x7fbbfc169e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc00a64640 1 -- 172.21.15.114:0/2234865956 learned_addr learned my addr 172.21.15.114:0/2234865956 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16a380 0x7fbbfc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc08b6d0 con 0x7fbbfc06f4d0 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc16fd00 con 0x7fbbfc16e980 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbbfc08b850 con 0x7fbbfc16a380 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbbfbfff640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbfc16e980 0x7fbbfc169e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbbfbfff640 1 -- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16a380 msgr2=0x7fbbfc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbbfbfff640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16a380 0x7fbbfc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7fbbfbfff640 1 -- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 msgr2=0x7fbbfc1661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7fbbfbfff640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc1661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7fbbfbfff640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc162e40 con 0x7fbbfc16e980 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7fbc00a64640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc1661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7f8673280640 1 Processor -- start 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7f8673280640 1 -- start start 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f8673280640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86640e7a70 0x7f866404b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7fbbfbfff640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbfc16e980 0x7fbbfc169e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0ccfe0 tx=0x7fbbe800da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50b401c070 con 0x7f50bc070640 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc068c80 con 0x7f50bc070640 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f50b8ff9640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f509c06c940 0x7f509c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f50b408b690 con 0x7f50bc070640 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8018020 con 0x7fbbfc16e980 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc163120 con 0x7fbbfc16e980 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc1636e0 con 0x7fbbfc16e980 2024-04-13T02:44:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe8014620 con 0x7fbbfc16e980 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80149f0 con 0x7fbbfc16e980 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.043+0000 7f5bc4faa640 1 -- 172.21.15.114:0/2532034510 wait complete. 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f5bc4faa640 1 Processor -- start 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f5bc4faa640 1 -- start start 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bc4faa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5bc00b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bc4faa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 0x7f5bc0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bc4faa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bc00cef20 0x7f5bc00cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bc4faa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc00ce530 con 0x7f5bc015c810 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bc4faa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0160330 con 0x7f5bc00cef20 2024-04-13T02:44:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bc4faa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc00d0290 con 0x7f5ba80052e0 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f261ae26640 1 Processor -- start 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f261ae26640 1 -- start start 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261ae26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26140d32a0 0x7f26140b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261ae26640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2614162db0 0x7f2614165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261ae26640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2614166840 0x7f26141658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261ae26640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2614073e50 con 0x7f26140d32a0 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261ae26640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2614073cd0 con 0x7f2614162db0 2024-04-13T02:44:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261ae26640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f26140c8280 con 0x7f2614166840 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7f7a351f7640 1 Processor -- start 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.044+0000 7f7a351f7640 1 -- start start 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a351f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a28037c20 0x7f7a281071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a351f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 0x7f7a28107700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a351f7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2819f580 0x7f7a2819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a351f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7a28033f60 con 0x7f7a281051e0 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a351f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a28053af0 con 0x7f7a28037c20 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a351f7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7a281055c0 con 0x7f7a2819f580 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a2e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 0x7f7a28107700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a2f59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2819f580 0x7f7a2819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a2e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 0x7f7a28107700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52988/0 (socket says 172.21.15.114:52988) 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f7a2e59c640 1 -- 172.21.15.114:0/2090574650 learned_addr learned my addr 172.21.15.114:0/2090574650 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f7a2e59c640 1 -- 172.21.15.114:0/2090574650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2819f580 msgr2=0x7f7a2819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f7a2e59c640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2819f580 0x7f7a2819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f7a2e59c640 1 -- 172.21.15.114:0/2090574650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a28037c20 msgr2=0x7f7a281071c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f7a2e59c640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a28037c20 0x7f7a281071c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f7a2e59c640 1 -- 172.21.15.114:0/2090574650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a28106400 con 0x7f7a281051e0 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f7a2e59c640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 0x7f7a28107700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002db70 tx=0x7f7a300637c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300a3040 con 0x7f7a281051e0 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f5998288640 1 -- 172.21.15.114:0/3519233582 shutdown_connections 2024-04-13T02:44:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f867101c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86640e7a70 0x7f866404b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f8673280640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 0x7f86640d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f8673280640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f8664050e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f8673280640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8664057630 con 0x7f86640e7a70 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f867081b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 0x7f86640d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f867081b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 0x7f86640d7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59680/0 (socket says 172.21.15.114:59680) 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f867081b640 1 -- 172.21.15.114:0/1522360226 learned_addr learned my addr 172.21.15.114:0/1522360226 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8664057350 con 0x7f86640eb060 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f86640e1e10 con 0x7f86640eb440 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f867181d640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f8664050e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7feb90e26640 1 Processor -- start 2024-04-13T02:44:45.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.046+0000 7feb90e26640 1 -- start start 2024-04-13T02:44:45.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bbe59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5bc00b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bbdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 0x7f5bc0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bbdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 0x7f5bc0156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52996/0 (socket says 172.21.15.114:52996) 2024-04-13T02:44:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f50bb7fe640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f509c06c940 0x7f509c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bbdd9b640 1 -- 172.21.15.114:0/914472721 learned_addr learned my addr 172.21.15.114:0/914472721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bc00cef20 0x7f5bc00cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f2619e24640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26140d32a0 0x7f26140b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f2619e24640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26140d32a0 0x7f26140b9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52990/0 (socket says 172.21.15.114:52990) 2024-04-13T02:44:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f2619e24640 1 -- 172.21.15.114:0/4171613064 learned_addr learned my addr 172.21.15.114:0/4171613064 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f2619623640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2614162db0 0x7f2614165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.045+0000 7f5998288640 1 -- 172.21.15.114:0/3519233582 wait complete. 2024-04-13T02:44:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f5998288640 1 Processor -- start 2024-04-13T02:44:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f261a625640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2614166840 0x7f26141658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f867081b640 1 -- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 msgr2=0x7f8664050e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f867081b640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f8664050e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f867081b640 1 -- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86640e7a70 msgr2=0x7f866404b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5998288640 1 -- start start 2024-04-13T02:44:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f867081b640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86640e7a70 0x7f866404b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f867081b640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86640509b0 con 0x7f86640eb060 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7feb90e26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 0x7feb840df100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7feb90e26640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb8404ffd0 0x7feb84036a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7feb90e26640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8417d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7feb90e26640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb84054940 con 0x7feb84038110 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7feb90e26640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feb840547c0 con 0x7feb8404ffd0 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7feb90e26640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7feb8404f550 con 0x7feb840ead00 2024-04-13T02:44:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f867181d640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f8664050e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 0x7feb840df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f2619623640 1 -- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2614166840 msgr2=0x7f26141658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f2619623640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2614166840 0x7f26141658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f2619623640 1 -- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26140d32a0 msgr2=0x7f26140b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f2619623640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26140d32a0 0x7f26140b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f2619623640 1 -- 172.21.15.114:0/4171613064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2614070bc0 con 0x7f2614162db0 2024-04-13T02:44:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 0x7feb840df100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53008/0 (socket says 172.21.15.114:53008) 2024-04-13T02:44:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5bbed9d640 1 -- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 msgr2=0x7f5bc00b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5bc00b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5bbed9d640 1 -- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 msgr2=0x7f5bc0156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f50bb7fe640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f509c06c940 0x7f509c06ee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50ac036000 tx=0x7f50ac008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 -- 172.21.15.114:0/364386436 learned_addr learned my addr 172.21.15.114:0/364386436 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f2619623640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2614162db0 0x7f2614165360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2604033000 tx=0x7f26040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f867081b640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 0x7f86640d7e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f865c009870 tx=0x7f865c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 0x7f5bc0156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5bbed9d640 1 -- 172.21.15.114:0/914472721 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc00b7520 con 0x7f5bc00cef20 2024-04-13T02:44:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc005290 con 0x7fbbfc16e980 2024-04-13T02:44:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f5bbdd9b640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 0x7f5bc0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604040070 con 0x7f2614162db0 2024-04-13T02:44:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2604030d00 con 0x7f2614162db0 2024-04-13T02:44:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c032860 con 0x7f86640eb060 2024-04-13T02:44:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 -- 172.21.15.114:0/364386436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 msgr2=0x7feb8417d420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-13T02:44:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8417d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 -- 172.21.15.114:0/364386436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb8404ffd0 msgr2=0x7feb84036a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-13T02:44:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb8404ffd0 0x7feb84036a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604035040 con 0x7f2614162db0 2024-04-13T02:44:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7feb8b7fe640 1 -- 172.21.15.114:0/364386436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84034420 con 0x7feb84038110 2024-04-13T02:44:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2614070ea0 con 0x7f2614162db0 2024-04-13T02:44:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2614071460 con 0x7f2614162db0 2024-04-13T02:44:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5bbed9d640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bc00cef20 0x7f5bc00cf3a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bc008c060 tx=0x7f5bb8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7feb8b7fe640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 0x7feb840df100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c7f0 tx=0x7feb8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5998288640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 0x7f5990159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5998288640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59900b0510 0x7f59901f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86640dac70 con 0x7f86640eb060 2024-04-13T02:44:45.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865c032a00 con 0x7f86640eb060 2024-04-13T02:44:45.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.048+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c032df0 con 0x7f86640eb060 2024-04-13T02:44:45.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5998288640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59901446e0 0x7f599013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5996024640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 0x7f5990159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86640d8360 con 0x7f86640eb060 2024-04-13T02:44:45.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5996024640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 0x7f5990159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59690/0 (socket says 172.21.15.114:59690) 2024-04-13T02:44:45.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbbe801b020 con 0x7fbbfc16e980 2024-04-13T02:44:45.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5996024640 1 -- 172.21.15.114:0/3633480023 learned_addr learned my addr 172.21.15.114:0/3633480023 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:45.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f599006f0a0 con 0x7f59901446e0 2024-04-13T02:44:45.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f599006edc0 con 0x7f599006ce80 2024-04-13T02:44:45.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.049+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f59900b4350 con 0x7f59900b0510 2024-04-13T02:44:45.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a281066e0 con 0x7f7a281051e0 2024-04-13T02:44:45.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.047+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2819ff40 con 0x7f7a281051e0 2024-04-13T02:44:45.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a300aa670 con 0x7f7a281051e0 2024-04-13T02:44:45.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300aaa20 con 0x7f7a281051e0 2024-04-13T02:44:45.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996825640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59901446e0 0x7f599013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7fbbf97fa640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbbe006c970 0x7fbbe006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2614071660 con 0x7f2614162db0 2024-04-13T02:44:45.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996024640 1 -- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59900b0510 msgr2=0x7f59901f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996024640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59900b0510 0x7f59901f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996024640 1 -- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59901446e0 msgr2=0x7f599013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbbe808c190 con 0x7fbbfc16e980 2024-04-13T02:44:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7fbc00a64640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbbe006c970 0x7fbbe006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996024640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59901446e0 0x7f599013ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996024640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59901f4c50 con 0x7f599006ce80 2024-04-13T02:44:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f5996825640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59901446e0 0x7f599013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.050+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86640057e0 con 0x7f86640eb060 2024-04-13T02:44:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.051+0000 7f5996024640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 0x7f5990159ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f598000c3f0 tx=0x7f598000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.051+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a10005290 con 0x7f7a281051e0 2024-04-13T02:44:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.051+0000 7fbc00a64640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbbe006c970 0x7fbbe006ee30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000f60 tx=0x7fbbf0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80015070 con 0x7feb84038110 2024-04-13T02:44:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7feb90e26640 1 -- 172.21.15.114:0/364386436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb84034700 con 0x7feb84038110 2024-04-13T02:44:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8039040 con 0x7f5bc00cef20 2024-04-13T02:44:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7feb90e26640 1 -- 172.21.15.114:0/364386436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb84034cc0 con 0x7feb84038110 2024-04-13T02:44:45.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50b40595e0 con 0x7f50bc070640 2024-04-13T02:44:45.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59800074e0 con 0x7f599006ce80 2024-04-13T02:44:45.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5990140da0 con 0x7f599006ce80 2024-04-13T02:44:45.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc00c6390 con 0x7f5bc00cef20 2024-04-13T02:44:45.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbe8022020 con 0x7fbbfc16e980 2024-04-13T02:44:45.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc00c6950 con 0x7f5bc00cef20 2024-04-13T02:44:45.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.054+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59901f4ef0 con 0x7f599006ce80 2024-04-13T02:44:45.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.055+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80004220 con 0x7feb84038110 2024-04-13T02:44:45.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.055+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5980007680 con 0x7f599006ce80 2024-04-13T02:44:45.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8001e060 con 0x7feb84038110 2024-04-13T02:44:45.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7feb90e26640 1 -- 172.21.15.114:0/364386436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6c005290 con 0x7feb84038110 2024-04-13T02:44:45.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.055+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb802cbc0 con 0x7f5bc00cef20 2024-04-13T02:44:45.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.055+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8009c80 con 0x7f5bc00cef20 2024-04-13T02:44:45.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.055+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59900755c0 con 0x7f599006ce80 2024-04-13T02:44:45.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f260404b060 con 0x7f2614162db0 2024-04-13T02:44:45.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7f260a7fc640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f25f806c9f0 0x7f25f806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba4005290 con 0x7f5bc00cef20 2024-04-13T02:44:45.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59800049e0 con 0x7f599006ce80 2024-04-13T02:44:45.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f26040adbe0 con 0x7f2614162db0 2024-04-13T02:44:45.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f2619e24640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f25f806c9f0 0x7f25f806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bb8047030 con 0x7f5bc00cef20 2024-04-13T02:44:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f865c04c060 con 0x7f86640eb060 2024-04-13T02:44:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7f8661ffb640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f865006c8f0 0x7f865006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.056+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f865c0ad4c0 con 0x7f86640eb060 2024-04-13T02:44:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f5baeffd640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5ba006c920 0x7f5ba006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f2619e24640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f25f806c9f0 0x7f25f806eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2610006fd0 tx=0x7f2610008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.057+0000 7f867101c640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f865006c8f0 0x7f865006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f5bbe59c640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5ba006c920 0x7f5ba006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a300b3020 con 0x7f7a281051e0 2024-04-13T02:44:45.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f867101c640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f865006c8f0 0x7f865006edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8668009890 tx=0x7f8668008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f5bbe59c640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5ba006c920 0x7f5ba006ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0001eb0 tx=0x7f5bb0007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f7a177fe640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7a1c06c9c0 0x7f7a1c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f7a2ed9d640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7a1c06c9c0 0x7f7a1c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.058+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a301176b0 con 0x7f7a281051e0 2024-04-13T02:44:45.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.059+0000 7f7a2ed9d640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7a1c06c9c0 0x7f7a1c06ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7a200095d0 tx=0x7f7a20006b30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.060+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb80007830 con 0x7feb84038110 2024-04-13T02:44:45.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.060+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f865c040070 con 0x7f86640eb060 2024-04-13T02:44:45.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.060+0000 7feb77fff640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb7006c8f0 0x7feb7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.060+0000 7feb8affd640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb7006c8f0 0x7feb7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.061+0000 7feb8affd640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb7006c8f0 0x7feb7006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb84037ff0 tx=0x7feb78009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.062+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb80057f60 con 0x7feb84038110 2024-04-13T02:44:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.062+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a300e5ac0 con 0x7f7a281051e0 2024-04-13T02:44:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.064+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5bb80791e0 con 0x7f5bc00cef20 2024-04-13T02:44:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.064+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2614071660 con 0x7f2614162db0 2024-04-13T02:44:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.066+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5980011070 con 0x7f599006ce80 2024-04-13T02:44:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.066+0000 7f5986ffd640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f597406c8f0 0x7f597406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.067+0000 7f5995823640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f597406c8f0 0x7f597406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.067+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb8005a5c0 con 0x7feb84038110 2024-04-13T02:44:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.067+0000 7f5995823640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f597406c8f0 0x7f597406edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5988036000 tx=0x7f598802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.069+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5980057bb0 con 0x7f599006ce80 2024-04-13T02:44:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.069+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bb804e060 con 0x7f5bc00cef20 2024-04-13T02:44:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.075+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f598005a210 con 0x7f599006ce80 2024-04-13T02:44:45.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.470+0000 7feb90e26640 1 -- 172.21.15.114:0/364386436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feb6c005850 con 0x7feb84038110 2024-04-13T02:44:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.471+0000 7feb77fff640 1 -- 172.21.15.114:0/364386436 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb80059ec0 con 0x7feb84038110 2024-04-13T02:44:45.472 INFO:teuthology.orchestra.run.smithi114.stdout:55834574853 2024-04-13T02:44:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.474+0000 7feb75ffb640 1 -- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb7006c8f0 msgr2=0x7feb7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.474+0000 7feb75ffb640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb7006c8f0 0x7feb7006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb84037ff0 tx=0x7feb78009240 comp rx=0 tx=0).stop 2024-04-13T02:44:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.474+0000 7feb75ffb640 1 -- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 msgr2=0x7feb840df100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.474+0000 7feb75ffb640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 0x7feb840df100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c7f0 tx=0x7feb8000ccb0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 -- 172.21.15.114:0/364386436 shutdown_connections 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb7006c8f0 0x7feb7006edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7feb840ead00 0x7feb8417d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feb8404ffd0 0x7feb84036a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 --2- 172.21.15.114:0/364386436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb84038110 0x7feb840df100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 -- 172.21.15.114:0/364386436 >> 172.21.15.114:0/364386436 conn(0x7feb84009fb0 msgr2=0x7feb8403a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 -- 172.21.15.114:0/364386436 shutdown_connections 2024-04-13T02:44:45.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.476+0000 7feb75ffb640 1 -- 172.21.15.114:0/364386436 wait complete. 2024-04-13T02:44:45.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.480+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f50bc073170 con 0x7f50bc070640 2024-04-13T02:44:45.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.480+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7a10005850 con 0x7f7a281051e0 2024-04-13T02:44:45.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.481+0000 7f50b8ff9640 1 -- 172.21.15.114:0/1332439058 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50b405d8e0 con 0x7f50bc070640 2024-04-13T02:44:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.481+0000 7f7a177fe640 1 -- 172.21.15.114:0/2090574650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a300e53c0 con 0x7f7a281051e0 2024-04-13T02:44:45.482 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:45.482 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:45.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8664007520 con 0x7f86640eb060 2024-04-13T02:44:45.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbbdc005850 con 0x7fbbfc16e980 2024-04-13T02:44:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f509c06c940 msgr2=0x7f509c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f509c06c940 0x7f509c06ee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f50ac036000 tx=0x7f50ac008030 comp rx=0 tx=0).stop 2024-04-13T02:44:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 msgr2=0x7f50bc204c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 0x7f50bc204c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50b400ba50 tx=0x7f50b400bf10 comp rx=0 tx=0).stop 2024-04-13T02:44:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 shutdown_connections 2024-04-13T02:44:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50bc0ceaa0 0x7f50bc06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7fbbf97fa640 1 -- 172.21.15.114:0/2234865956 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbbe805a510 con 0x7fbbfc16e980 2024-04-13T02:44:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f509c06c940 0x7f509c06ee00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50bc072100 0x7f50bc1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 --2- 172.21.15.114:0/1332439058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc070640 0x7f50bc204c70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 >> 172.21.15.114:0/1332439058 conn(0x7f50bc0b28b0 msgr2=0x7f50bc0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.487 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f8661ffb640 1 -- 172.21.15.114:0/1522360226 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86640387e0 con 0x7f86640eb060 2024-04-13T02:44:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 shutdown_connections 2024-04-13T02:44:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.484+0000 7f50c231e640 1 -- 172.21.15.114:0/1332439058 wait complete. 2024-04-13T02:44:45.488 INFO:teuthology.orchestra.run.smithi114.stdout:55834574853 2024-04-13T02:44:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7a1c06c9c0 msgr2=0x7f7a1c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7a1c06c9c0 0x7f7a1c06ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7a200095d0 tx=0x7f7a20006b30 comp rx=0 tx=0).stop 2024-04-13T02:44:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 msgr2=0x7f7a28107700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 0x7f7a28107700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a3002db70 tx=0x7f7a300637c0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 shutdown_connections 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7a1c06c9c0 0x7f7a1c06ee80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2819f580 0x7f7a2819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a281051e0 0x7f7a28107700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 --2- 172.21.15.114:0/2090574650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a28037c20 0x7f7a281071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 >> 172.21.15.114:0/2090574650 conn(0x7f7a28009fb0 msgr2=0x7f7a280049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.485+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 shutdown_connections 2024-04-13T02:44:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.486+0000 7f7a351f7640 1 -- 172.21.15.114:0/2090574650 wait complete. 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f865006c8f0 msgr2=0x7f865006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f865006c8f0 0x7f865006edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8668009890 tx=0x7f8668008040 comp rx=0 tx=0).stop 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 msgr2=0x7f86640d7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 0x7f86640d7e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f865c009870 tx=0x7f865c0046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbbe006c970 msgr2=0x7fbbe006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbbe006c970 0x7fbbe006ee30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000f60 tx=0x7fbbf0009040 comp rx=0 tx=0).stop 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbfc16e980 msgr2=0x7fbbfc169e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbfc16e980 0x7fbbfc169e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0ccfe0 tx=0x7fbbe800da50 comp rx=0 tx=0).stop 2024-04-13T02:44:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 shutdown_connections 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbbe006c970 0x7fbbe006ee30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbfc16a380 0x7fbbfc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbfc16e980 0x7fbbfc169e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 --2- 172.21.15.114:0/2234865956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbfc06f4d0 0x7fbbfc1661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 >> 172.21.15.114:0/2234865956 conn(0x7fbbfc067b40 msgr2=0x7fbbfc0b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 shutdown_connections 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f865006c8f0 0x7f865006edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86640eb440 0x7f8664050e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86640eb060 0x7f86640d7e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 --2- 172.21.15.114:0/1522360226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86640e7a70 0x7f866404b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 >> 172.21.15.114:0/1522360226 conn(0x7f86640559e0 msgr2=0x7f86640e8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 shutdown_connections 2024-04-13T02:44:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.488+0000 7f8673280640 1 -- 172.21.15.114:0/1522360226 wait complete. 2024-04-13T02:44:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.489+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 shutdown_connections 2024-04-13T02:44:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.489+0000 7fbc01a66640 1 -- 172.21.15.114:0/2234865956 wait complete. 2024-04-13T02:44:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.489+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f26140b9f80 con 0x7f2614162db0 2024-04-13T02:44:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.490+0000 7f260a7fc640 1 -- 172.21.15.114:0/4171613064 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f260407bff0 con 0x7f2614162db0 2024-04-13T02:44:45.493 INFO:teuthology.orchestra.run.smithi114.stdout:55834574853 2024-04-13T02:44:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.491+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5ba4005580 con 0x7f5bc00cef20 2024-04-13T02:44:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.493+0000 7f5baeffd640 1 -- 172.21.15.114:0/914472721 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5bb807b140 con 0x7f5bc00cef20 2024-04-13T02:44:45.494 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f25f806c9f0 msgr2=0x7f25f806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f25f806c9f0 0x7f25f806eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2610006fd0 tx=0x7f2610008040 comp rx=0 tx=0).stop 2024-04-13T02:44:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2614162db0 msgr2=0x7f2614165360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2614162db0 0x7f2614165360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2604033000 tx=0x7f26040046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 shutdown_connections 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f25f806c9f0 0x7f25f806eeb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2614166840 0x7f26141658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2614162db0 0x7f2614165360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 --2- 172.21.15.114:0/4171613064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26140d32a0 0x7f26140b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 >> 172.21.15.114:0/4171613064 conn(0x7f261406d3d0 msgr2=0x7f26140ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 shutdown_connections 2024-04-13T02:44:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.494+0000 7f261ae26640 1 -- 172.21.15.114:0/4171613064 wait complete. 2024-04-13T02:44:45.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-04-13T02:44:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.496+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f599013f3f0 con 0x7f599006ce80 2024-04-13T02:44:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.496+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5ba006c920 msgr2=0x7f5ba006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.496+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5ba006c920 0x7f5ba006ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0001eb0 tx=0x7f5bb0007040 comp rx=0 tx=0).stop 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.496+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bc00cef20 msgr2=0x7f5bc00cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.496+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bc00cef20 0x7f5bc00cf3a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5bc008c060 tx=0x7f5bb8004ab0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 shutdown_connections 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5bc00cef20 0x7f5bc00cf3a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc015c810 0x7f5bc0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5ba006c920 0x7f5ba006ede0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 --2- 172.21.15.114:0/914472721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5ba80052e0 0x7f5bc00b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 >> 172.21.15.114:0/914472721 conn(0x7f5bc00d26c0 msgr2=0x7f5bc006ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 shutdown_connections 2024-04-13T02:44:45.499 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5986ffd640 1 -- 172.21.15.114:0/3633480023 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5980059b10 con 0x7f599006ce80 2024-04-13T02:44:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.497+0000 7f5bc4faa640 1 -- 172.21.15.114:0/914472721 wait complete. 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.500+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f597406c8f0 msgr2=0x7f597406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f597406c8f0 0x7f597406edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5988036000 tx=0x7f598802e000 comp rx=0 tx=0).stop 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 msgr2=0x7f5990159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 0x7f5990159ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f598000c3f0 tx=0x7f598000c8b0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 shutdown_connections 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59901446e0 0x7f599013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f597406c8f0 0x7f597406edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59900b0510 0x7f59901f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 --2- 172.21.15.114:0/3633480023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f599006ce80 0x7f5990159ab0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f598000c3f0 tx=0x7f598000c8b0 comp rx=0 tx=0).stop 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 >> 172.21.15.114:0/3633480023 conn(0x7f59900728c0 msgr2=0x7f599013d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 shutdown_connections 2024-04-13T02:44:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:45.501+0000 7f5998288640 1 -- 172.21.15.114:0/3633480023 wait complete. 2024-04-13T02:44:45.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-04-13T02:44:45.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-13T02:44:45.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-04-13T02:44:45.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-13T02:44:45.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-13T02:44:45.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-13T02:44:45.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-13T02:44:46.498 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-13T02:44:46.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-13T02:44:46.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-13T02:44:46.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-13T02:44:46.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-13T02:44:46.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-13T02:44:46.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-13T02:44:46.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.654+0000 7fe3a759e640 1 Processor -- start 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.654+0000 7fe3a759e640 1 -- start start 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.655+0000 7fe3a759e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a0057480 0x7fe3a0036db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.655+0000 7fe3a759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a00545c0 con 0x7fe3a004a390 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.655+0000 7fe3a759e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a0007c60 con 0x7fe3a0049fb0 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.655+0000 7fe3a759e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a00513c0 con 0x7fe3a0057480 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.656+0000 7fe3a6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe3a004a390 0x7fe3a0051f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58910/0 (socket says 172.21.15.114:58910) 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.656+0000 7fe3a6d9d640 1 -- 172.21.15.114:0/2926813866 learned_addr learned my addr 172.21.15.114:0/2926813866 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593672274 0 0) 0x7fe3a00545c0 con 0x7fe3a004a390 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe390003520 con 0x7fe3a004a390 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3553375543 0 0) 0x7fe390003520 con 0x7fe3a004a390 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a0057480 msgr2=0x7fe3a0036db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a0057480 0x7fe3a0036db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 >> v1:172.21.15.130:6789/0 conn(0x7fe3a0049fb0 legacy=0x7fe3a0051850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a0007f40 con 0x7fe3a004a390 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fe3a8075e80 con 0x7fe3a004a390 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 >> v1:172.21.15.114:6789/0 conn(0x7fe3a004a390 legacy=0x7fe3a0051f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe390003a60 0x7fe390003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe390004800 0x7fe390004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.657+0000 7fe3a559a640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3900051c0 0x7fe39000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe39002e0a0 con 0x7fe390003a60 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe39002e250 con 0x7fe3900051c0 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe39002e450 con 0x7fe390004800 2024-04-13T02:44:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a6d9d640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3900051c0 0x7fe39000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a5d9b640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe390004800 0x7fe390004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a659c640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe390003a60 0x7fe390003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a6d9d640 1 -- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe390004800 msgr2=0x7fe390004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a6d9d640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe390004800 0x7fe390004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a6d9d640 1 -- 172.21.15.114:0/2926813866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe390003a60 msgr2=0x7fe390003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a6d9d640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe390003a60 0x7fe390003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.658+0000 7fe3a6d9d640 1 -- 172.21.15.114:0/2926813866 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390003520 con 0x7fe3900051c0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.660+0000 7fe3a6d9d640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3900051c0 0x7fe39000b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3a802db70 tx=0x7fe390005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23258d5a6030915d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.660+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8069450 con 0x7fe3900051c0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.660+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a80ac070 con 0x7fe3900051c0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.660+0000 7fe3a559a640 1 -- 172.21.15.114:0/2926813866 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a806b930 con 0x7fe3900051c0 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.662+0000 7fe3a759e640 1 -- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3900051c0 msgr2=0x7fe39000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.662+0000 7fe3a759e640 1 --2- 172.21.15.114:0/2926813866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3900051c0 0x7fe39000b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3a802db70 tx=0x7fe390005830 comp rx=0 tx=0).stop 2024-04-13T02:44:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.663+0000 7fe3a6d9d640 1 -- 172.21.15.114:0/2926813866 reap_dead start 2024-04-13T02:44:46.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.663+0000 7fe3a759e640 1 -- 172.21.15.114:0/2926813866 shutdown_connections 2024-04-13T02:44:46.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.663+0000 7fe3a759e640 1 -- 172.21.15.114:0/2926813866 >> 172.21.15.114:0/2926813866 conn(0x7fe3a0020040 msgr2=0x7fe3a0056d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.663+0000 7fe3a759e640 1 -- 172.21.15.114:0/2926813866 shutdown_connections 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.663+0000 7fe3a759e640 1 -- 172.21.15.114:0/2926813866 wait complete. 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.665+0000 7fe3a759e640 1 Processor -- start 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.665+0000 7fe3a759e640 1 -- start start 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 0x7fe3a00d2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 0x7fe3a00d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 0x7fe3a00d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53032/0 (socket says 172.21.15.114:53032) 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a659c640 1 -- 172.21.15.114:0/750995464 learned_addr learned my addr 172.21.15.114:0/750995464 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a759e640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a00e4170 0x7fe3a00e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a759e640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3a00d3e30 0x7fe3a00d42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0054000 con 0x7fe3900051c0 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0038580 con 0x7fe3a00d3e30 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.667+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a0054180 con 0x7fe3a00e4170 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a5d9b640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a00e4170 0x7fe3a00e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a659c640 1 -- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a00e4170 msgr2=0x7fe3a00e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a659c640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a00e4170 0x7fe3a00e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a659c640 1 -- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3a00d3e30 msgr2=0x7fe3a00d42b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a659c640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3a00d3e30 0x7fe3a00d42b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a659c640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a00e0520 con 0x7fe3900051c0 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.668+0000 7fe3a659c640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 0x7fe3a00d2830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe39800d800 tx=0x7fe39800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.670+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398018020 con 0x7fe3900051c0 2024-04-13T02:44:46.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.670+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a00e0800 con 0x7fe3900051c0 2024-04-13T02:44:46.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.670+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a00e3690 con 0x7fe3900051c0 2024-04-13T02:44:46.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.672+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3980096a0 con 0x7fe3900051c0 2024-04-13T02:44:46.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.673+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398009a70 con 0x7fe3900051c0 2024-04-13T02:44:46.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.674+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe39801b020 con 0x7fe3900051c0 2024-04-13T02:44:46.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.674+0000 7fe396ffd640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe390090a40 0x7fe390092f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.675+0000 7fe3a5d9b640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe390090a40 0x7fe390092f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.675+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe39808bfd0 con 0x7fe3900051c0 2024-04-13T02:44:46.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.675+0000 7fe3a5d9b640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe390090a40 0x7fe390092f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe39c006fd0 tx=0x7fe39c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.677+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c005290 con 0x7fe3900051c0 2024-04-13T02:44:46.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.686+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe398022020 con 0x7fe3900051c0 2024-04-13T02:44:46.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.711+0000 7f909b59e640 1 Processor -- start 2024-04-13T02:44:46.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.712+0000 7f909b59e640 1 -- start start 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909b59e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9094008d20 0x7f909403a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909b59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f909403ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909b59e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9094032d30 con 0x7f9094008940 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909b59e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9094033940 con 0x7f9094008d20 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909b59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9094033010 con 0x7f9094032830 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909a59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9094008940 0x7f9094006ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47714/0 (socket says 172.21.15.114:47714) 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f909a59c640 1 -- 172.21.15.114:0/3115180703 learned_addr learned my addr 172.21.15.114:0/3115180703 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f9099d9b640 1 --2- 172.21.15.114:0/3115180703 >> v2:172.21.15.130:3300/0 conn(0x7f9094008d20 0x7f909403a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f909ad9d640 1 --2- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f909403ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f909959a640 1 -- 172.21.15.114:0/3115180703 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041149213 0 0) 0x7f9094032d30 con 0x7f9094008940 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f909959a640 1 -- 172.21.15.114:0/3115180703 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9084003520 con 0x7f9094008940 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f9099d9b640 1 -- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 msgr2=0x7f909403ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f9099d9b640 1 --2- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f909403ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f9099d9b640 1 -- 172.21.15.114:0/3115180703 >> v1:172.21.15.130:6789/0 conn(0x7f9094008940 legacy=0x7f9094006ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f9099d9b640 1 -- 172.21.15.114:0/3115180703 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940332f0 con 0x7f9094008d20 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.712+0000 7f7ee1215640 1 Processor -- start 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.712+0000 7f7ee1215640 1 -- start start 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f7ee1215640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ed40e7640 0x7f7ed4054560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f7ee1215640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ed4054b30 0x7f7ed404f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f7ee1215640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed4050220 con 0x7f7ed404fa10 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f7ee1215640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed404fe80 con 0x7f7ed40e7640 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.713+0000 7f7ee1215640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed4053970 con 0x7f7ed4054b30 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ed4054b30 0x7f7ed404f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edb7fe640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7ed4054b30 0x7f7ed404f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59702/0 (socket says 172.21.15.114:59702) 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edb7fe640 1 -- 172.21.15.114:0/3908641777 learned_addr learned my addr 172.21.15.114:0/3908641777 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edbfff640 1 --2- 172.21.15.114:0/3908641777 >> v2:172.21.15.114:3300/0 conn(0x7f7ed40e7640 0x7f7ed4054560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edbfff640 1 -- 172.21.15.114:0/3908641777 >> v2:172.21.15.130:3300/0 conn(0x7f7ed4054b30 msgr2=0x7f7ed404f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edbfff640 1 --2- 172.21.15.114:0/3908641777 >> v2:172.21.15.130:3300/0 conn(0x7f7ed4054b30 0x7f7ed404f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edbfff640 1 -- 172.21.15.114:0/3908641777 >> v1:172.21.15.114:6789/0 conn(0x7f7ed404fa10 legacy=0x7f7ed40eb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.714+0000 7f7edbfff640 1 -- 172.21.15.114:0/3908641777 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed40485c0 con 0x7f7ed40e7640 2024-04-13T02:44:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.716+0000 7f7edbfff640 1 --2- 172.21.15.114:0/3908641777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed40e7640 0x7f7ed4054560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c170 tx=0x7f7ec802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe7108fd647df5f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.715+0000 7f9099d9b640 1 --2- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008d20 0x7f909403a920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90900097a0 tx=0x7f909002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc8640f5b24a313 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.716+0000 7f909959a640 1 -- 172.21.15.114:0/3115180703 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090034070 con 0x7f9094008d20 2024-04-13T02:44:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.716+0000 7f909959a640 1 -- 172.21.15.114:0/3115180703 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9090030840 con 0x7f9094008d20 2024-04-13T02:44:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.716+0000 7f7edaffd640 1 -- 172.21.15.114:0/3908641777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80315a0 con 0x7f7ed40e7640 2024-04-13T02:44:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.716+0000 7f7edaffd640 1 -- 172.21.15.114:0/3908641777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec8037070 con 0x7f7ed40e7640 2024-04-13T02:44:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f8949036640 1 Processor -- start 2024-04-13T02:44:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f8949036640 1 -- start start 2024-04-13T02:44:46.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 -- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008d20 msgr2=0x7f909403a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 --2- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008d20 0x7f909403a920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90900097a0 tx=0x7f909002b980 comp rx=0 tx=0).stop 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 -- 172.21.15.114:0/3115180703 shutdown_connections 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 --2- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f909403ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 --2- 172.21.15.114:0/3115180703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008d20 0x7f909403a920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 -- 172.21.15.114:0/3115180703 >> 172.21.15.114:0/3115180703 conn(0x7f909401ef40 msgr2=0x7f9094055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f0c8577e640 1 Processor -- start 2024-04-13T02:44:46.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f0c8577e640 1 -- start start 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7edaffd640 1 -- 172.21.15.114:0/3908641777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8031960 con 0x7f7ed40e7640 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 -- 172.21.15.114:0/3908641777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed40e7640 msgr2=0x7f7ed4054560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 --2- 172.21.15.114:0/3908641777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed40e7640 0x7f7ed4054560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c170 tx=0x7f7ec802b840 comp rx=0 tx=0).stop 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 -- 172.21.15.114:0/3908641777 shutdown_connections 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 --2- 172.21.15.114:0/3908641777 >> v2:172.21.15.130:3300/0 conn(0x7f7ed4054b30 0x7f7ed404f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 --2- 172.21.15.114:0/3908641777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed40e7640 0x7f7ed4054560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 -- 172.21.15.114:0/3908641777 >> 172.21.15.114:0/3908641777 conn(0x7f7ed400a400 msgr2=0x7f7ed400a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 -- 172.21.15.114:0/3115180703 shutdown_connections 2024-04-13T02:44:46.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f909b59e640 1 -- 172.21.15.114:0/3115180703 wait complete. 2024-04-13T02:44:46.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f7ee1215640 1 -- 172.21.15.114:0/3908641777 shutdown_connections 2024-04-13T02:44:46.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7fcf45a5e640 1 Processor -- start 2024-04-13T02:44:46.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f7ee1215640 1 -- 172.21.15.114:0/3908641777 wait complete. 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.717+0000 7f4b95526640 1 Processor -- start 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f4b95526640 1 -- start start 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8949036640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f89440b0ab0 0x7f89440d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8949036640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89440b0f10 0x7f89440d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8949036640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894415f440 con 0x7f89440b6c50 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8949036640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f894415f720 con 0x7f89440b0f10 2024-04-13T02:44:46.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8949036640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f894415fa00 con 0x7f89440b0ab0 2024-04-13T02:44:46.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f0c8577e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0c8015a8d0 0x7f0c800b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8942d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f89440b6c50 0x7f89440b7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58926/0 (socket says 172.21.15.114:58926) 2024-04-13T02:44:46.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f0c8577e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c8015efe0 0x7f0c8015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f8942d9d640 1 -- 172.21.15.114:0/2917002163 learned_addr learned my addr 172.21.15.114:0/2917002163 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f894359e640 1 --2- 172.21.15.114:0/2917002163 >> v2:172.21.15.114:3300/0 conn(0x7f89440b0f10 0x7f89440d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f894259c640 1 --2- 172.21.15.114:0/2917002163 >> v2:172.21.15.130:3300/0 conn(0x7f89440b0ab0 0x7f89440d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7fcf45a5e640 1 -- start start 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b95526640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4b88048040 0x7f4b8804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b8ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4b88048040 0x7f4b8804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b8ffff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4b88048040 0x7f4b8804fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59720/0 (socket says 172.21.15.114:59720) 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.718+0000 7f0c8577e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8006eff0 con 0x7f0c8015e8f0 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c7f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c8015efe0 0x7f0c8015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c7f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c8015efe0 0x7f0c8015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53060/0 (socket says 172.21.15.114:53060) 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/2160903517 learned_addr learned my addr 172.21.15.114:0/2160903517 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8015acb0 con 0x7f0c8015efe0 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8015ed50 con 0x7f0c8015a8d0 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c7ffff640 1 --2- 172.21.15.114:0/2160903517 >> v2:172.21.15.130:3300/0 conn(0x7f0c8015a8d0 0x7f0c800b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c7effd640 1 -- 172.21.15.114:0/2160903517 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728954036 0 0) 0x7f0c8006eff0 con 0x7f0c8015e8f0 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b8f7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4b88037bb0 0x7f4b88038010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47734/0 (socket says 172.21.15.114:47734) 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b95526640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b88048420 con 0x7f4b88038720 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b95526640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b880547a0 con 0x7f4b88037bb0 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b95526640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4b88053700 con 0x7f4b88048040 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f4b8ffff640 1 -- 172.21.15.114:0/2765304438 learned_addr learned my addr 172.21.15.114:0/2765304438 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f0c7effd640 1 -- 172.21.15.114:0/2160903517 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c68003520 con 0x7f0c8015e8f0 2024-04-13T02:44:46.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f7ee1215640 1 Processor -- start 2024-04-13T02:44:46.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f909b59e640 1 Processor -- start 2024-04-13T02:44:46.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.719+0000 7f909b59e640 1 -- start start 2024-04-13T02:44:46.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f4b8effd640 1 -- 172.21.15.114:0/2765304438 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287145057 0 0) 0x7f4b88048420 con 0x7f4b88038720 2024-04-13T02:44:46.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f4b8ffff640 1 -- 172.21.15.114:0/2765304438 >> v1:172.21.15.130:6789/0 conn(0x7f4b88037bb0 legacy=0x7f4b88038010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f4b8ffff640 1 -- 172.21.15.114:0/2765304438 >> v1:172.21.15.114:6789/0 conn(0x7f4b88038720 legacy=0x7f4b88006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f4b8ffff640 1 -- 172.21.15.114:0/2765304438 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b880539e0 con 0x7f4b88048040 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf45a5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf380df370 0x7fcf38054750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf3ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fcf3804f950 0x7fcf38053010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47738/0 (socket says 172.21.15.114:47738) 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf3ffff640 1 -- 172.21.15.114:0/3607586375 learned_addr learned my addr 172.21.15.114:0/3607586375 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf38053e30 con 0x7fcf38039300 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf38007000 con 0x7fcf3804f950 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf44a5c640 1 --2- 172.21.15.114:0/3607586375 >> v2:172.21.15.114:3300/0 conn(0x7fcf380df370 0x7fcf38054750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcf380072e0 con 0x7fcf380df370 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228581221 0 0) 0x7fcf38007000 con 0x7fcf3804f950 2024-04-13T02:44:46.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f909b59e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008940 0x7f90940e0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9094008d20 0x7f90940dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909b59e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f90940dc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f909403b5a0 con 0x7f9094008d20 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909b59e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f90940071c0 con 0x7f9094008940 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909b59e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f909403b720 con 0x7f9094032830 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/2160903517 >> v2:172.21.15.130:3300/0 conn(0x7f0c8015a8d0 msgr2=0x7f0c800b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f0c7f7fe640 1 --2- 172.21.15.114:0/2160903517 >> v2:172.21.15.130:3300/0 conn(0x7f0c8015a8d0 0x7f0c800b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/2160903517 >> v1:172.21.15.130:6789/0 conn(0x7f0c8015e8f0 legacy=0x7f0c800b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/2160903517 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8006f2d0 con 0x7f0c8015efe0 2024-04-13T02:44:46.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f9099d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9094008d20 0x7f90940dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f9099d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9094008d20 0x7f90940dbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53076/0 (socket says 172.21.15.114:53076) 2024-04-13T02:44:46.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f9099d9b640 1 -- 172.21.15.114:0/970631005 learned_addr learned my addr 172.21.15.114:0/970631005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f4b8ffff640 1 --2- 172.21.15.114:0/2765304438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88048040 0x7f4b8804fa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009870 tx=0x7f4b8402bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7c2d7cdd2e77c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909a59c640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008940 0x7f90940e0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f8c44fe0640 1 Processor -- start 2024-04-13T02:44:46.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f7ee1215640 1 -- start start 2024-04-13T02:44:46.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f4b8effd640 1 -- 172.21.15.114:0/2765304438 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8402d890 con 0x7f4b88048040 2024-04-13T02:44:46.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee1215640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7ed404fa10 0x7f7ed4047570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee1215640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed4054b30 0x7f7ed40d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee1215640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed40e7640 0x7f7ed40d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee1215640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed4053ea0 con 0x7f7ed4054b30 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee1215640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed4054210 con 0x7f7ed40e7640 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee1215640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed40e7a20 con 0x7f7ed404fa10 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f0c7f7fe640 1 --2- 172.21.15.114:0/2160903517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015efe0 0x7f0c8015e3b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006a240 tx=0x7f0c7402dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b44b1f248ec4e49 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30003520 con 0x7fcf3804f950 2024-04-13T02:44:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f4b8effd640 1 -- 172.21.15.114:0/2765304438 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8402da30 con 0x7f4b88048040 2024-04-13T02:44:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f4b8effd640 1 -- 172.21.15.114:0/2765304438 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8402de00 con 0x7f4b88048040 2024-04-13T02:44:46.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515037264 0 0) 0x7fcf38053e30 con 0x7fcf38039300 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f894259c640 1 -- 172.21.15.114:0/2917002163 >> v2:172.21.15.114:3300/0 conn(0x7f89440b0f10 msgr2=0x7f89440d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f894259c640 1 --2- 172.21.15.114:0/2917002163 >> v2:172.21.15.114:3300/0 conn(0x7f89440b0f10 0x7f89440d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f894259c640 1 -- 172.21.15.114:0/2917002163 >> v1:172.21.15.114:6789/0 conn(0x7f89440b6c50 legacy=0x7f89440b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.720+0000 7f894259c640 1 -- 172.21.15.114:0/2917002163 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894415fce0 con 0x7f89440b0ab0 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f894259c640 1 --2- 172.21.15.114:0/2917002163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b0ab0 0x7f89440d1450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89440d1180 tx=0x7f893402b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814c9adb9365661f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee0a14640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed40e7640 0x7f7ed40d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee0a14640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed40e7640 0x7f7ed40d4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59726/0 (socket says 172.21.15.114:59726) 2024-04-13T02:44:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7ee0a14640 1 -- 172.21.15.114:0/2647054769 learned_addr learned my addr 172.21.15.114:0/2647054769 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f7edbfff640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7ed404fa10 0x7f7ed4047570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf38007000 con 0x7fcf38039300 2024-04-13T02:44:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f8c44fe0640 1 -- start start 2024-04-13T02:44:46.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f8941d9b640 1 -- 172.21.15.114:0/2917002163 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934037070 con 0x7f89440b0ab0 2024-04-13T02:44:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f0c7effd640 1 -- 172.21.15.114:0/2160903517 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74008df0 con 0x7f0c8015efe0 2024-04-13T02:44:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f0c7effd640 1 -- 172.21.15.114:0/2160903517 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7400a0d0 con 0x7f0c8015efe0 2024-04-13T02:44:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3462550976 0 0) 0x7fcf30003520 con 0x7fcf3804f950 2024-04-13T02:44:46.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f0c7effd640 1 -- 172.21.15.114:0/2160903517 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400a4e0 con 0x7f0c8015efe0 2024-04-13T02:44:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7fcf44a5c640 1 -- 172.21.15.114:0/3607586375 >> v1:172.21.15.130:6789/0 conn(0x7fcf3804f950 legacy=0x7fcf38053010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f8941d9b640 1 -- 172.21.15.114:0/2917002163 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8934030710 con 0x7f89440b0ab0 2024-04-13T02:44:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f8941d9b640 1 -- 172.21.15.114:0/2917002163 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934037070 con 0x7f89440b0ab0 2024-04-13T02:44:46.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7fcf44a5c640 1 -- 172.21.15.114:0/3607586375 >> v1:172.21.15.114:6789/0 conn(0x7fcf38039300 legacy=0x7fcf38053720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7fcf44a5c640 1 -- 172.21.15.114:0/3607586375 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf380075c0 con 0x7fcf380df370 2024-04-13T02:44:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.721+0000 7f909ad9d640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f90940dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f909ad9d640 1 -- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008940 msgr2=0x7f90940e0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f909ad9d640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008940 0x7f90940e0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f909ad9d640 1 -- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9094008d20 msgr2=0x7f90940dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f909ad9d640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9094008d20 0x7f90940dbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f909ad9d640 1 -- 172.21.15.114:0/970631005 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940ddf10 con 0x7f9094032830 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f909ad9d640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f90940dc180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f909c051700 tx=0x7f909c069540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c098070 con 0x7f9094032830 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c075490 con 0x7f9094032830 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c075880 con 0x7f9094032830 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f4b95526640 1 -- 172.21.15.114:0/2765304438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88048040 msgr2=0x7f4b8804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f4b95526640 1 --2- 172.21.15.114:0/2765304438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88048040 0x7f4b8804fa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009870 tx=0x7f4b8402bad0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f7edb7fe640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed4054b30 0x7f7ed40d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f7edbfff640 1 -- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed40e7640 msgr2=0x7f7ed40d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f4b95526640 1 -- 172.21.15.114:0/2765304438 shutdown_connections 2024-04-13T02:44:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f4b95526640 1 --2- 172.21.15.114:0/2765304438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88048040 0x7f4b8804fa90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f4b95526640 1 -- 172.21.15.114:0/2765304438 >> 172.21.15.114:0/2765304438 conn(0x7f4b88009fb0 msgr2=0x7f4b8800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f7edbfff640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed40e7640 0x7f7ed40d4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f7edbfff640 1 -- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed4054b30 msgr2=0x7f7ed40d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 -- 172.21.15.114:0/2917002163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b0ab0 msgr2=0x7f89440d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 --2- 172.21.15.114:0/2917002163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b0ab0 0x7f89440d1450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89440d1180 tx=0x7f893402b620 comp rx=0 tx=0).stop 2024-04-13T02:44:46.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f4b95526640 1 -- 172.21.15.114:0/2765304438 shutdown_connections 2024-04-13T02:44:46.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f7edbfff640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed4054b30 0x7f7ed40d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f4b95526640 1 -- 172.21.15.114:0/2765304438 wait complete. 2024-04-13T02:44:46.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.722+0000 7f7edbfff640 1 -- 172.21.15.114:0/2647054769 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed40d0c30 con 0x7f7ed404fa10 2024-04-13T02:44:46.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 -- 172.21.15.114:0/2917002163 shutdown_connections 2024-04-13T02:44:46.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 --2- 172.21.15.114:0/2917002163 >> v2:172.21.15.114:3300/0 conn(0x7f89440b0f10 0x7f89440d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 --2- 172.21.15.114:0/2917002163 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b0ab0 0x7f89440d1450 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 -- 172.21.15.114:0/2917002163 >> 172.21.15.114:0/2917002163 conn(0x7f894409aa40 msgr2=0x7f894409ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9094186380 con 0x7f9094032830 2024-04-13T02:44:46.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90940de470 con 0x7f9094032830 2024-04-13T02:44:46.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7fcf44a5c640 1 --2- 172.21.15.114:0/3607586375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38054750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000b60 tx=0x7fcf400a7710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01471da7c2ecc87 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f7edbfff640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7ed404fa10 0x7f7ed4047570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8033000 tx=0x7f7ec80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c3e59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8c4014bf10 0x7f8c400d1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58968/0 (socket says 172.21.15.114:58968) 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c44fe0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c40166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c44fe0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c400b6080 con 0x7f8c4014bf10 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c44fe0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c40071010 con 0x7f8c4006f2f0 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c44fe0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8c400b4a80 con 0x7f8c400b7360 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c3e59c640 1 -- 172.21.15.114:0/4032585682 learned_addr learned my addr 172.21.15.114:0/4032585682 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:46.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8949036640 1 -- 172.21.15.114:0/2917002163 shutdown_connections 2024-04-13T02:44:46.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f8c3ed9d640 1 --2- 172.21.15.114:0/4032585682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c40166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015efe0 msgr2=0x7f0c8015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7f0c8577e640 1 --2- 172.21.15.114:0/2160903517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015efe0 0x7f0c8015e3b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006a240 tx=0x7f0c7402dad0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.723+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf400b3070 con 0x7fcf380df370 2024-04-13T02:44:46.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf400ae460 con 0x7fcf380df370 2024-04-13T02:44:46.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 shutdown_connections 2024-04-13T02:44:46.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7fcf3f7fe640 1 -- 172.21.15.114:0/3607586375 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c001670 con 0x7fcf380df370 2024-04-13T02:44:46.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f8c3d59a640 1 -- 172.21.15.114:0/4032585682 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51270470 0 0) 0x7f8c30001110 con 0x7f8c4014bf10 2024-04-13T02:44:46.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8032840 con 0x7f7ed404fa10 2024-04-13T02:44:46.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f0c8577e640 1 --2- 172.21.15.114:0/2160903517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015efe0 0x7f0c8015e3b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f8c3d59a640 1 -- 172.21.15.114:0/4032585682 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c28003520 con 0x7f8c4014bf10 2024-04-13T02:44:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f0c8577e640 1 --2- 172.21.15.114:0/2160903517 >> v2:172.21.15.130:3300/0 conn(0x7f0c8015a8d0 0x7f0c800b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 >> 172.21.15.114:0/2160903517 conn(0x7f0c800b2720 msgr2=0x7f0c800b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 shutdown_connections 2024-04-13T02:44:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f8949036640 1 -- 172.21.15.114:0/2917002163 wait complete. 2024-04-13T02:44:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed40d0f10 con 0x7f7ed404fa10 2024-04-13T02:44:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed4045100 con 0x7f7ed404fa10 2024-04-13T02:44:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec80329e0 con 0x7f7ed404fa10 2024-04-13T02:44:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8032db0 con 0x7f7ed404fa10 2024-04-13T02:44:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90940057e0 con 0x7f9094032830 2024-04-13T02:44:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 msgr2=0x7fcf38054750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/3607586375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38054750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000b60 tx=0x7fcf400a7710 comp rx=0 tx=0).stop 2024-04-13T02:44:46.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/4032585682 >> v1:172.21.15.130:6789/0 conn(0x7f8c4006f2f0 legacy=0x7f8c400b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7f4b95526640 1 Processor -- start 2024-04-13T02:44:46.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7f4b95526640 1 -- start start 2024-04-13T02:44:46.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed40057e0 con 0x7f7ed404fa10 2024-04-13T02:44:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/4032585682 >> v1:172.21.15.114:6789/0 conn(0x7f8c4014bf10 legacy=0x7f8c400d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7f0c8577e640 1 -- 172.21.15.114:0/2160903517 wait complete. 2024-04-13T02:44:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.724+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/4032585682 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c400b6300 con 0x7f8c400b7360 2024-04-13T02:44:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7f8c3ed9d640 1 --2- 172.21.15.114:0/4032585682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c40166bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c340097d0 tx=0x7f8c3402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1e15c125d452a90 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.725+0000 7f8c3d59a640 1 -- 172.21.15.114:0/4032585682 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34034070 con 0x7f8c400b7360 2024-04-13T02:44:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f8c3d59a640 1 -- 172.21.15.114:0/4032585682 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c34030610 con 0x7f8c400b7360 2024-04-13T02:44:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f8c3d59a640 1 -- 172.21.15.114:0/4032585682 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c340309e0 con 0x7f8c400b7360 2024-04-13T02:44:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b95526640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 0x7f4b880e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b95526640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88038720 0x7f4b88049f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 0x7f4b880e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f8949036640 1 Processor -- start 2024-04-13T02:44:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 shutdown_connections 2024-04-13T02:44:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/3607586375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38054750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 >> 172.21.15.114:0/3607586375 conn(0x7fcf380550f0 msgr2=0x7fcf38055500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 0x7f4b880e04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53100/0 (socket says 172.21.15.114:53100) 2024-04-13T02:44:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b8ffff640 1 -- 172.21.15.114:0/662956879 learned_addr learned my addr 172.21.15.114:0/662956879 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f8949036640 1 -- start start 2024-04-13T02:44:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f909c09b070 con 0x7f9094032830 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f908affd640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f907c06c9c0 0x7f907c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f909c1069e0 con 0x7f9094032830 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f909a59c640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f907c06c9c0 0x7f907c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f909a59c640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f907c06c9c0 0x7f907c06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f908c005880 tx=0x7f908c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 -- 172.21.15.114:0/4032585682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 msgr2=0x7f8c40166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/4032585682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c40166bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c340097d0 tx=0x7f8c3402b960 comp rx=0 tx=0).stop 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 -- 172.21.15.114:0/4032585682 shutdown_connections 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/4032585682 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c40166bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 -- 172.21.15.114:0/4032585682 >> 172.21.15.114:0/4032585682 conn(0x7f8c4009aa40 msgr2=0x7f8c4009ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 -- 172.21.15.114:0/4032585682 shutdown_connections 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f0c8577e640 1 Processor -- start 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f0c8577e640 1 -- start start 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b88048040 0x7f4b88048e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88054280 con 0x7f4b88037bb0 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88053fa0 con 0x7f4b88038720 2024-04-13T02:44:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8804ffd0 con 0x7f4b88048040 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8f7fe640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88038720 0x7f4b88049f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8ffff640 1 -- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b88048040 msgr2=0x7f4b88048e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8ffff640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b88048040 0x7f4b88048e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8ffff640 1 -- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88038720 msgr2=0x7f4b88049f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8ffff640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88038720 0x7f4b88049f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8ffff640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8804c990 con 0x7f4b88037bb0 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f4b8ffff640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 0x7f4b880e04f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009990 tx=0x7f4b840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84037a40 con 0x7f4b88037bb0 2024-04-13T02:44:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f8949036640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 0x7f89440b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b84047070 con 0x7f4b88037bb0 2024-04-13T02:44:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84037e20 con 0x7f4b88037bb0 2024-04-13T02:44:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8804bde0 con 0x7f4b88037bb0 2024-04-13T02:44:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8804a4d0 con 0x7f4b88037bb0 2024-04-13T02:44:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f8949036640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89440b0f10 0x7f89440b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.726+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 shutdown_connections 2024-04-13T02:44:46.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7fcf45a5e640 1 -- 172.21.15.114:0/3607586375 wait complete. 2024-04-13T02:44:46.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f8942d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 0x7f89440b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ec804e430 con 0x7f7ed404fa10 2024-04-13T02:44:46.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f8942d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 0x7f89440b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53112/0 (socket says 172.21.15.114:53112) 2024-04-13T02:44:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.727+0000 7f8c44fe0640 1 -- 172.21.15.114:0/4032585682 wait complete. 2024-04-13T02:44:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f8942d9d640 1 -- 172.21.15.114:0/4044020946 learned_addr learned my addr 172.21.15.114:0/4044020946 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7fcf45a5e640 1 Processor -- start 2024-04-13T02:44:46.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b6c50 0x7f89440cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7fcf45a5e640 1 -- start start 2024-04-13T02:44:46.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.728+0000 7f894259c640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89440b0f10 0x7f89440b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f894359e640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b6c50 0x7f89440cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f7ed8ff9640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7ec006c9c0 0x7f7ec006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f89440b0750 con 0x7f89440b0ab0 2024-04-13T02:44:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89440b05d0 con 0x7f89440b6c50 2024-04-13T02:44:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f89440aecd0 con 0x7f89440b0f10 2024-04-13T02:44:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ec802f030 con 0x7f7ed404fa10 2024-04-13T02:44:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8c44fe0640 1 Processor -- start 2024-04-13T02:44:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c8577e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015a8d0 0x7f0c8014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8c44fe0640 1 -- start start 2024-04-13T02:44:46.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c8577e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0c8015e8f0 0x7f0c80159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c8577e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 0x7f0c8014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c8577e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8006f890 con 0x7f0c8015a8d0 2024-04-13T02:44:46.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c8577e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8006fc00 con 0x7f0c8015efe0 2024-04-13T02:44:46.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c8577e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0c800b5c90 con 0x7f0c8015e8f0 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c7f7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0c8015e8f0 0x7f0c80159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c84f7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 0x7f0c8014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c84f7d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 0x7f0c8014ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59758/0 (socket says 172.21.15.114:59758) 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f0c84f7d640 1 -- 172.21.15.114:0/3519966735 learned_addr learned my addr 172.21.15.114:0/3519966735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8942d9d640 1 -- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89440b0f10 msgr2=0x7f89440b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8942d9d640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89440b0f10 0x7f89440b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8942d9d640 1 -- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b6c50 msgr2=0x7f89440cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8942d9d640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b6c50 0x7f89440cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.729+0000 7f8942d9d640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89440b4220 con 0x7f89440b0ab0 2024-04-13T02:44:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7ffff640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015a8d0 0x7f0c8014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf45a5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf38039300 0x7fcf38168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf45a5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 0x7fcf380e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 msgr2=0x7f0c8014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7f7fe640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 0x7f0c8014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015a8d0 msgr2=0x7f0c8014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7f7fe640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015a8d0 0x7f0c8014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7f7fe640 1 -- 172.21.15.114:0/3519966735 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8014d7c0 con 0x7f0c8015e8f0 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f8c44fe0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c4006f2f0 0x7f8c400b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf44a5c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf38039300 0x7fcf38168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c84f7d640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 0x7f0c8014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf44a5c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf38039300 0x7fcf38168630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:59768/0 (socket says 172.21.15.114:59768) 2024-04-13T02:44:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f8c44fe0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c4009eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f0c7f7fe640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0c8015e8f0 0x7f0c80159ac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c80070e20 tx=0x7f0c740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f8c3e59c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c4006f2f0 0x7f8c400b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf3ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 0x7fcf380e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf3ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 0x7fcf380e17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41396/0 (socket says 172.21.15.114:41396) 2024-04-13T02:44:46.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf3ffff640 1 -- 172.21.15.114:0/442093180 learned_addr learned my addr 172.21.15.114:0/442093180 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38035730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f8942d9d640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 0x7f89440b26b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f893800c620 tx=0x7f893800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c3dd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c4009eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c3dd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c4009eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:41404/0 (socket says 172.21.15.114:41404) 2024-04-13T02:44:46.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.730+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b84040050 con 0x7f4b88037bb0 2024-04-13T02:44:46.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b70005290 con 0x7f4b88037bb0 2024-04-13T02:44:46.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f7edb7fe640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7ec006c9c0 0x7f7ec006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938018070 con 0x7f89440b0ab0 2024-04-13T02:44:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7fcf46cc0640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38035730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89440b3c60 con 0x7f89440b0ab0 2024-04-13T02:44:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89380074e0 con 0x7f89440b0ab0 2024-04-13T02:44:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf380df750 con 0x7fcf380df370 2024-04-13T02:44:46.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c44fe0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 0x7f8c400afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938007690 con 0x7f89440b0ab0 2024-04-13T02:44:46.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89440b1eb0 con 0x7f89440b0ab0 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c44fe0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400b6950 con 0x7f8c4014bf10 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c44fe0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4014c2f0 con 0x7f8c4006f2f0 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c44fe0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8c40070c10 con 0x7f8c400b7360 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c3ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 0x7f8c400afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c3ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 0x7f8c400afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53136/0 (socket says 172.21.15.114:53136) 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/986605399 learned_addr learned my addr 172.21.15.114:0/986605399 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.731+0000 7f7edb7fe640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7ec006c9c0 0x7f7ec006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7edc02db70 tx=0x7f7edc063410 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38007b80 con 0x7fcf38039300 2024-04-13T02:44:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcf380d5e40 con 0x7fcf3804f950 2024-04-13T02:44:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f4b8cff9640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4b7406c9c0 0x7f4b7406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ec8040070 con 0x7f7ed404fa10 2024-04-13T02:44:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/986605399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 msgr2=0x7f8c4009eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f4b8f7fe640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4b7406c9c0 0x7f4b7406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8c3ed9d640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c4009eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/986605399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c4006f2f0 msgr2=0x7f8c400b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8c3ed9d640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c4006f2f0 0x7f8c400b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8c3ed9d640 1 -- 172.21.15.114:0/986605399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c400b09d0 con 0x7f8c4014bf10 2024-04-13T02:44:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8c3ed9d640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 0x7f8c400afd80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009720 tx=0x7f8c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.732+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8944068c80 con 0x7f89440b0ab0 2024-04-13T02:44:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf3ffff640 1 -- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf38039300 msgr2=0x7fcf38168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf3ffff640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf38039300 0x7fcf38168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf3ffff640 1 -- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 msgr2=0x7fcf38035730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b840aded0 con 0x7f4b88037bb0 2024-04-13T02:44:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf3ffff640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38035730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7f4b8f7fe640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4b7406c9c0 0x7f4b7406ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4b880e3f10 tx=0x7f4b7c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf3ffff640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf380e2280 con 0x7fcf3804f950 2024-04-13T02:44:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf46cc0640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38035730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.733+0000 7fcf3ffff640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 0x7fcf380e17c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00c780 tx=0x7fcf2c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.734+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f893801b070 con 0x7f89440b0ab0 2024-04-13T02:44:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.734+0000 7f892b7fe640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f893006c8f0 0x7f893006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.734+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f893808ae90 con 0x7f89440b0ab0 2024-04-13T02:44:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.734+0000 7f894259c640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f893006c8f0 0x7f893006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.735+0000 7f894259c640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f893006c8f0 0x7f893006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8934034000 tx=0x7f8934008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c018070 con 0x7fcf3804f950 2024-04-13T02:44:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c007500 con 0x7fcf3804f950 2024-04-13T02:44:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf38167b50 con 0x7fcf3804f950 2024-04-13T02:44:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c004a20 con 0x7fcf3804f950 2024-04-13T02:44:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf38168110 con 0x7fcf3804f950 2024-04-13T02:44:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74048070 con 0x7f0c8015e8f0 2024-04-13T02:44:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f90940ddf10 con 0x7f9094032830 2024-04-13T02:44:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7402fc10 con 0x7f0c8015e8f0 2024-04-13T02:44:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74030460 con 0x7f0c8015e8f0 2024-04-13T02:44:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.736+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8014daa0 con 0x7f0c8015e8f0 2024-04-13T02:44:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.737+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8014e060 con 0x7f0c8015e8f0 2024-04-13T02:44:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.738+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf38009000 con 0x7fcf3804f950 2024-04-13T02:44:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.738+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c800755c0 con 0x7f0c8015e8f0 2024-04-13T02:44:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.738+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34034040 con 0x7f8c4014bf10 2024-04-13T02:44:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.738+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c400b0cb0 con 0x7f8c4014bf10 2024-04-13T02:44:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.738+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b84050020 con 0x7f4b88037bb0 2024-04-13T02:44:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.738+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c400b1270 con 0x7f8c4014bf10 2024-04-13T02:44:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.739+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c7404b070 con 0x7f0c8015e8f0 2024-04-13T02:44:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.739+0000 7f0c7cff9640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0c6c06c9c0 0x7f0c6c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.739+0000 7f0c7ffff640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0c6c06c9c0 0x7f0c6c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.740+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0c740afa20 con 0x7f0c8015e8f0 2024-04-13T02:44:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.739+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf2c01b070 con 0x7fcf3804f950 2024-04-13T02:44:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.739+0000 7fcf3d7fa640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf2406c8f0 0x7fcf2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.740+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf2c08b040 con 0x7fcf3804f950 2024-04-13T02:44:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.740+0000 7fcf44a5c640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf2406c8f0 0x7fcf2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.740+0000 7fcf44a5c640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf2406c8f0 0x7fcf2406edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf38039790 tx=0x7fcf40068810 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.740+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c401632a0 con 0x7f8c4014bf10 2024-04-13T02:44:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.741+0000 7f0c7ffff640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0c6c06c9c0 0x7f0c6c06ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c78003aa0 tx=0x7f0c78009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.743+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c7407d7e0 con 0x7f0c8015e8f0 2024-04-13T02:44:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.744+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8938058d00 con 0x7f89440b0ab0 2024-04-13T02:44:46.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.744+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c34030410 con 0x7f8c4014bf10 2024-04-13T02:44:46.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.744+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34039910 con 0x7f8c4014bf10 2024-04-13T02:44:46.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.747+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c34037070 con 0x7f8c4014bf10 2024-04-13T02:44:46.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.747+0000 7f8c2effd640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8c2006c8f0 0x7f8c2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:46.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.748+0000 7f8c3e59c640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8c2006c8f0 0x7f8c2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.749+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c340ae5c0 con 0x7f8c4014bf10 2024-04-13T02:44:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.749+0000 7f8c3e59c640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8c2006c8f0 0x7f8c2006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005880 tx=0x7f8c30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.749+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf2c058d80 con 0x7fcf3804f950 2024-04-13T02:44:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:46.755+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c401632a0 con 0x7f8c4014bf10 2024-04-13T02:44:47.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.095+0000 7fe3a759e640 1 -- 172.21.15.114:0/750995464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe38c005580 con 0x7fe3900051c0 2024-04-13T02:44:47.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.095+0000 7fe396ffd640 1 -- 172.21.15.114:0/750995464 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe39805a3e0 con 0x7fe3900051c0 2024-04-13T02:44:47.096 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:47.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.098+0000 7fe394ff9640 1 -- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe390090a40 msgr2=0x7fe390092f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.098+0000 7fe394ff9640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe390090a40 0x7fe390092f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe39c006fd0 tx=0x7fe39c008040 comp rx=0 tx=0).stop 2024-04-13T02:44:47.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 -- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 msgr2=0x7fe3a00d2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 0x7fe3a00d2830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe39800d800 tx=0x7fe39800dcc0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 -- 172.21.15.114:0/750995464 shutdown_connections 2024-04-13T02:44:47.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3a00d3e30 0x7fe3a00d42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe390090a40 0x7fe390092f00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe3a00e4170 0x7fe3a00e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 --2- 172.21.15.114:0/750995464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3900051c0 0x7fe3a00d2830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 -- 172.21.15.114:0/750995464 >> 172.21.15.114:0/750995464 conn(0x7fe3a0020040 msgr2=0x7fe3a0049600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.099+0000 7fe394ff9640 1 -- 172.21.15.114:0/750995464 shutdown_connections 2024-04-13T02:44:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.100+0000 7fe394ff9640 1 -- 172.21.15.114:0/750995464 wait complete. 2024-04-13T02:44:47.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-04-13T02:44:47.117 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.134+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4b70005580 con 0x7f4b88037bb0 2024-04-13T02:44:47.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.134+0000 7f4b8cff9640 1 -- 172.21.15.114:0/662956879 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b8407c2e0 con 0x7f4b88037bb0 2024-04-13T02:44:47.135 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:47.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4b7406c9c0 msgr2=0x7f4b7406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4b7406c9c0 0x7f4b7406ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4b880e3f10 tx=0x7f4b7c007e80 comp rx=0 tx=0).stop 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 msgr2=0x7f4b880e04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 0x7f4b880e04f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009990 tx=0x7f4b840046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 shutdown_connections 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4b7406c9c0 0x7f4b7406ee80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b88048040 0x7f4b88048e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b88038720 0x7f4b88049f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 --2- 172.21.15.114:0/662956879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b88037bb0 0x7f4b880e04f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.136+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 >> 172.21.15.114:0/662956879 conn(0x7f4b88009fb0 msgr2=0x7f4b88006cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.137+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 shutdown_connections 2024-04-13T02:44:47.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.137+0000 7f4b95526640 1 -- 172.21.15.114:0/662956879 wait complete. 2024-04-13T02:44:47.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-13T02:44:47.148 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.157+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7ed400b250 con 0x7f7ed404fa10 2024-04-13T02:44:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.157+0000 7f7ed8ff9640 1 -- 172.21.15.114:0/2647054769 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ed400b250 con 0x7f7ed404fa10 2024-04-13T02:44:47.158 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:47.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.158+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f90940e2360 con 0x7f9094032830 2024-04-13T02:44:47.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.159+0000 7f908affd640 1 -- 172.21.15.114:0/970631005 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f909c090070 con 0x7f9094032830 2024-04-13T02:44:47.160 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.159+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7ec006c9c0 msgr2=0x7f7ec006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.159+0000 7f7ee1215640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7ec006c9c0 0x7f7ec006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7edc02db70 tx=0x7f7edc063410 comp rx=0 tx=0).stop 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7ed404fa10 msgr2=0x7f7ed4047570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7ed404fa10 0x7f7ed4047570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8033000 tx=0x7f7ec80046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 shutdown_connections 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7ed40e7640 0x7f7ed40d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ed4054b30 0x7f7ed40d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7ec006c9c0 0x7f7ec006ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 --2- 172.21.15.114:0/2647054769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7ed404fa10 0x7f7ed4047570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 >> 172.21.15.114:0/2647054769 conn(0x7f7ed400a400 msgr2=0x7f7ed404b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 shutdown_connections 2024-04-13T02:44:47.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.160+0000 7f7ee1215640 1 -- 172.21.15.114:0/2647054769 wait complete. 2024-04-13T02:44:47.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.161+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f907c06c9c0 msgr2=0x7f907c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.161+0000 7f909b59e640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f907c06c9c0 0x7f907c06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f908c005880 tx=0x7f908c009040 comp rx=0 tx=0).stop 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.161+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 msgr2=0x7f90940dc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.161+0000 7f909b59e640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f90940dc180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f909c051700 tx=0x7f909c069540 comp rx=0 tx=0).stop 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 shutdown_connections 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f907c06c9c0 0x7f907c06ee80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9094032830 0x7f90940dc180 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9094008d20 0x7f90940dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 --2- 172.21.15.114:0/970631005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9094008940 0x7f90940e0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 >> 172.21.15.114:0/970631005 conn(0x7f909401ef40 msgr2=0x7f909400b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 shutdown_connections 2024-04-13T02:44:47.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.162+0000 7f909b59e640 1 -- 172.21.15.114:0/970631005 wait complete. 2024-04-13T02:44:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.170+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0c800b5320 con 0x7f0c8015e8f0 2024-04-13T02:44:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.170+0000 7f0c7cff9640 1 -- 172.21.15.114:0/3519966735 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c74081ae0 con 0x7f0c8015e8f0 2024-04-13T02:44:47.171 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:47.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.172+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f894406f600 con 0x7f89440b0ab0 2024-04-13T02:44:47.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.172+0000 7f892b7fe640 1 -- 172.21.15.114:0/4044020946 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f893805d000 con 0x7f89440b0ab0 2024-04-13T02:44:47.173 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:47.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcf380059c0 con 0x7fcf3804f950 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0c6c06c9c0 msgr2=0x7f0c6c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0c6c06c9c0 0x7f0c6c06ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c78003aa0 tx=0x7f0c78009830 comp rx=0 tx=0).stop 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0c8015e8f0 msgr2=0x7f0c80159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0c8015e8f0 0x7f0c80159ac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0c80070e20 tx=0x7f0c740046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 shutdown_connections 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c8015efe0 0x7f0c8014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0c6c06c9c0 0x7f0c6c06ee80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0c8015e8f0 0x7f0c80159ac0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.173+0000 7f0c8577e640 1 --2- 172.21.15.114:0/3519966735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8015a8d0 0x7f0c8014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.174+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 >> 172.21.15.114:0/3519966735 conn(0x7f0c800b2720 msgr2=0x7f0c800b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.174+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 shutdown_connections 2024-04-13T02:44:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.174+0000 7f0c8577e640 1 -- 172.21.15.114:0/3519966735 wait complete. 2024-04-13T02:44:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.174+0000 7fcf3d7fa640 1 -- 172.21.15.114:0/442093180 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf2c05d080 con 0x7fcf3804f950 2024-04-13T02:44:47.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.174+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8c40068c80 con 0x7f8c4014bf10 2024-04-13T02:44:47.176 INFO:teuthology.orchestra.run.smithi114.stdout:55834574854 2024-04-13T02:44:47.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.174+0000 7f8c2effd640 1 -- 172.21.15.114:0/986605399 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c3407c9d0 con 0x7f8c4014bf10 2024-04-13T02:44:47.177 INFO:teuthology.orchestra.run.smithi114.stdout:55834574855 2024-04-13T02:44:47.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.175+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f893006c8f0 msgr2=0x7f893006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.175+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f893006c8f0 0x7f893006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8934034000 tx=0x7f8934008030 comp rx=0 tx=0).stop 2024-04-13T02:44:47.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.175+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 msgr2=0x7f89440b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.175+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 0x7f89440b26b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f893800c620 tx=0x7f893800cae0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-04-13T02:44:47.179 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 shutdown_connections 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89440b6c50 0x7f89440cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f893006c8f0 0x7f893006edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89440b0f10 0x7f89440b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 --2- 172.21.15.114:0/4044020946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89440b0ab0 0x7f89440b26b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 >> 172.21.15.114:0/4044020946 conn(0x7f894409aa40 msgr2=0x7f89440b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 shutdown_connections 2024-04-13T02:44:47.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.176+0000 7f8949036640 1 -- 172.21.15.114:0/4044020946 wait complete. 2024-04-13T02:44:47.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf2406c8f0 msgr2=0x7fcf2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf2406c8f0 0x7fcf2406edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf38039790 tx=0x7fcf40068810 comp rx=0 tx=0).stop 2024-04-13T02:44:47.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 msgr2=0x7fcf380e17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 0x7fcf380e17c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00c780 tx=0x7fcf2c00cc40 comp rx=0 tx=0).stop 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 shutdown_connections 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf380df370 0x7fcf38035730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcf2406c8f0 0x7fcf2406edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf3804f950 0x7fcf380e17c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 --2- 172.21.15.114:0/442093180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf38039300 0x7fcf38168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 >> 172.21.15.114:0/442093180 conn(0x7fcf380550f0 msgr2=0x7fcf3803a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 shutdown_connections 2024-04-13T02:44:47.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7fcf45a5e640 1 -- 172.21.15.114:0/442093180 wait complete. 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8c2006c8f0 msgr2=0x7f8c2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8c2006c8f0 0x7f8c2006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005880 tx=0x7f8c30009040 comp rx=0 tx=0).stop 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 msgr2=0x7f8c400afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.177+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 0x7f8c400afd80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009720 tx=0x7f8c340046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 shutdown_connections 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c4014bf10 0x7f8c400afd80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8c2006c8f0 0x7f8c2006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8c400b7360 0x7f8c4009eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 --2- 172.21.15.114:0/986605399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c4006f2f0 0x7f8c400b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 >> 172.21.15.114:0/986605399 conn(0x7f8c4009aa40 msgr2=0x7f8c4014a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 shutdown_connections 2024-04-13T02:44:47.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.178+0000 7f8c44fe0640 1 -- 172.21.15.114:0/986605399 wait complete. 2024-04-13T02:44:47.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-04-13T02:44:47.185 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-13T02:44:47.191 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-13T02:44:47.192 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-13T02:44:47.193 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-13T02:44:47.195 DEBUG:teuthology.parallel:result is None 2024-04-13T02:44:47.195 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-13T02:44:47.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:44:47.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.333+0000 7fa3e95aa640 1 Processor -- start 2024-04-13T02:44:47.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.333+0000 7fa3e95aa640 1 -- start start 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e95aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e95aa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3e4073890 0x7fa3e40aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e95aa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e4162760 con 0x7fa3e406cb50 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e95aa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e40cd8f0 con 0x7fa3e4073890 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e95aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e4160090 con 0x7fa3e4159240 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3e4073890 0x7fa3e40aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e27fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa3e406cb50 0x7fa3e4073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58976/0 (socket says 172.21.15.114:58976) 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3e4073890 0x7fa3e40aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53140/0 (socket says 172.21.15.114:53140) 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.334+0000 7fa3e37fe640 1 -- 172.21.15.114:0/3576719119 learned_addr learned my addr 172.21.15.114:0/3576719119 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.335+0000 7fa3e37fe640 1 -- 172.21.15.114:0/3576719119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 msgr2=0x7fa3e415fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.335+0000 7fa3e37fe640 1 --2- 172.21.15.114:0/3576719119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.335+0000 7fa3e37fe640 1 -- 172.21.15.114:0/3576719119 >> v1:172.21.15.114:6789/0 conn(0x7fa3e406cb50 legacy=0x7fa3e4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.335+0000 7fa3e37fe640 1 -- 172.21.15.114:0/3576719119 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41629d0 con 0x7fa3e4073890 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.335+0000 7fa3e1ffb640 1 -- 172.21.15.114:0/3576719119 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1592403251 0 0) 0x7fa3e4162760 con 0x7fa3e406cb50 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.335+0000 7fa3e37fe640 1 --2- 172.21.15.114:0/3576719119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e4073890 0x7fa3e40aed10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009870 tx=0x7fa3dc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354973a1fd680cc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e1ffb640 1 -- 172.21.15.114:0/3576719119 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc034070 con 0x7fa3e4073890 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e1ffb640 1 -- 172.21.15.114:0/3576719119 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc030840 con 0x7fa3e4073890 2024-04-13T02:44:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e1ffb640 1 -- 172.21.15.114:0/3576719119 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc030c10 con 0x7fa3e4073890 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 -- 172.21.15.114:0/3576719119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e4073890 msgr2=0x7fa3e40aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/3576719119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e4073890 0x7fa3e40aed10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009870 tx=0x7fa3dc02b980 comp rx=0 tx=0).stop 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 -- 172.21.15.114:0/3576719119 shutdown_connections 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/3576719119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e4073890 0x7fa3e40aed10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/3576719119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 -- 172.21.15.114:0/3576719119 >> 172.21.15.114:0/3576719119 conn(0x7fa3e406f860 msgr2=0x7fa3e4072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 -- 172.21.15.114:0/3576719119 shutdown_connections 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.336+0000 7fa3e95aa640 1 -- 172.21.15.114:0/3576719119 wait complete. 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.337+0000 7fa3e95aa640 1 Processor -- start 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.337+0000 7fa3e95aa640 1 -- start start 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e95aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 0x7fa3e414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e95aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4073890 0x7fa3e415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e95aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e95aa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40af250 con 0x7fa3e406cb50 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e95aa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4162f90 con 0x7fa3e4073890 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e95aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e40af3d0 con 0x7fa3e4159240 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 0x7fa3e414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 0x7fa3e414aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53156/0 (socket says 172.21.15.114:53156) 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 -- 172.21.15.114:0/2675477997 learned_addr learned my addr 172.21.15.114:0/2675477997 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e37fe640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e27fc640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4073890 0x7fa3e415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 -- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 msgr2=0x7fa3e415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 -- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4073890 msgr2=0x7fa3e415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4073890 0x7fa3e415de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.338+0000 7fa3e2ffd640 1 -- 172.21.15.114:0/2675477997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e40d0940 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.339+0000 7fa3e2ffd640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 0x7fa3e414aa60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400ba80 tx=0x7fa3d400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.339+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4019070 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.339+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d400cc20 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.339+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e40cfb80 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.339+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4014440 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.339+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e40d0140 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.340+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e4068c80 con 0x7fa3e406cb50 2024-04-13T02:44:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.340+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3d401c070 con 0x7fa3e406cb50 2024-04-13T02:44:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.341+0000 7fa3db7fe640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa3c406c8f0 0x7fa3c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.341+0000 7fa3e27fc640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa3c406c8f0 0x7fa3c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.341+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa3d408b7a0 con 0x7fa3e406cb50 2024-04-13T02:44:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.341+0000 7fa3e27fc640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa3c406c8f0 0x7fa3c406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc007fd0 tx=0x7fa3cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.345+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3d4059580 con 0x7fa3e406cb50 2024-04-13T02:44:47.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.518+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3e40ae5f0 con 0x7fa3c406c8f0 2024-04-13T02:44:47.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.524+0000 7fa3db7fe640 1 -- 172.21.15.114:0/2675477997 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fa3e40ae5f0 con 0x7fa3c406c8f0 2024-04-13T02:44:47.527 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:47.529 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.526+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa3c406c8f0 msgr2=0x7fa3c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.526+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa3c406c8f0 0x7fa3c406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc007fd0 tx=0x7fa3cc009040 comp rx=0 tx=0).stop 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 msgr2=0x7fa3e414aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 0x7fa3e414aa60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400ba80 tx=0x7fa3d400bf40 comp rx=0 tx=0).stop 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 shutdown_connections 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa3c406c8f0 0x7fa3c406edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3e4159240 0x7fa3e415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3e4073890 0x7fa3e415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 --2- 172.21.15.114:0/2675477997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e406cb50 0x7fa3e414aa60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 >> 172.21.15.114:0/2675477997 conn(0x7fa3e406f860 msgr2=0x7fa3e40b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 shutdown_connections 2024-04-13T02:44:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.527+0000 7fa3e95aa640 1 -- 172.21.15.114:0/2675477997 wait complete. 2024-04-13T02:44:47.538 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-13T02:44:47.489853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002593"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229767+0000","last_change":"2024-04-13T02:44:40.230633+0000","last_active":"2024-04-13T02:44:41.229767+0000","last_peered":"2024-04-13T02:44:41.229767+0000","last_clean":"2024-04-13T02:44:41.229767+0000","last_became_active":"2024-04-13T02:44:40.229553+0000","last_became_peered":"2024-04-13T02:44:40.229553+0000","last_unstale":"2024-04-13T02:44:41.229767+0000","last_undegraded":"2024-04-13T02:44:41.229767+0000","last_fullsized":"2024-04-13T02:44:41.229767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:17:28.338011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223475+0000","last_change":"2024-04-13T02:44:40.222537+0000","last_active":"2024-04-13T02:44:41.223475+0000","last_peered":"2024-04-13T02:44:41.223475+0000","last_clean":"2024-04-13T02:44:41.223475+0000","last_became_active":"2024-04-13T02:44:40.222285+0000","last_became_peered":"2024-04-13T02:44:40.222285+0000","last_unstale":"2024-04-13T02:44:41.223475+0000","last_undegraded":"2024-04-13T02:44:41.223475+0000","last_fullsized":"2024-04-13T02:44:41.223475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286895+0000","last_change":"2024-04-13T02:44:40.224528+0000","last_active":"2024-04-13T02:44:41.286895+0000","last_peered":"2024-04-13T02:44:41.286895+0000","last_clean":"2024-04-13T02:44:41.286895+0000","last_became_active":"2024-04-13T02:44:40.224212+0000","last_became_peered":"2024-04-13T02:44:40.224212+0000","last_unstale":"2024-04-13T02:44:41.286895+0000","last_undegraded":"2024-04-13T02:44:41.286895+0000","last_fullsized":"2024-04-13T02:44:41.286895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286877+0000","last_change":"2024-04-13T02:44:40.236982+0000","last_active":"2024-04-13T02:44:41.286877+0000","last_peered":"2024-04-13T02:44:41.286877+0000","last_clean":"2024-04-13T02:44:41.286877+0000","last_became_active":"2024-04-13T02:44:40.236331+0000","last_became_peered":"2024-04-13T02:44:40.236331+0000","last_unstale":"2024-04-13T02:44:41.286877+0000","last_undegraded":"2024-04-13T02:44:41.286877+0000","last_fullsized":"2024-04-13T02:44:41.286877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230228+0000","last_change":"2024-04-13T02:44:40.219544+0000","last_active":"2024-04-13T02:44:41.230228+0000","last_peered":"2024-04-13T02:44:41.230228+0000","last_clean":"2024-04-13T02:44:41.230228+0000","last_became_active":"2024-04-13T02:44:40.219255+0000","last_became_peered":"2024-04-13T02:44:40.219255+0000","last_unstale":"2024-04-13T02:44:41.230228+0000","last_undegraded":"2024-04-13T02:44:41.230228+0000","last_fullsized":"2024-04-13T02:44:41.230228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:56:10.757469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286700+0000","last_change":"2024-04-13T02:44:40.238704+0000","last_active":"2024-04-13T02:44:41.286700+0000","last_peered":"2024-04-13T02:44:41.286700+0000","last_clean":"2024-04-13T02:44:41.286700+0000","last_became_active":"2024-04-13T02:44:40.238452+0000","last_became_peered":"2024-04-13T02:44:40.238452+0000","last_unstale":"2024-04-13T02:44:41.286700+0000","last_undegraded":"2024-04-13T02:44:41.286700+0000","last_fullsized":"2024-04-13T02:44:41.286700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229704+0000","last_change":"2024-04-13T02:44:40.226014+0000","last_active":"2024-04-13T02:44:41.229704+0000","last_peered":"2024-04-13T02:44:41.229704+0000","last_clean":"2024-04-13T02:44:41.229704+0000","last_became_active":"2024-04-13T02:44:40.223159+0000","last_became_peered":"2024-04-13T02:44:40.223159+0000","last_unstale":"2024-04-13T02:44:41.229704+0000","last_undegraded":"2024-04-13T02:44:41.229704+0000","last_fullsized":"2024-04-13T02:44:41.229704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:52:45.259162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287186+0000","last_change":"2024-04-13T02:44:40.238313+0000","last_active":"2024-04-13T02:44:41.287186+0000","last_peered":"2024-04-13T02:44:41.287186+0000","last_clean":"2024-04-13T02:44:41.287186+0000","last_became_active":"2024-04-13T02:44:40.238050+0000","last_became_peered":"2024-04-13T02:44:40.238050+0000","last_unstale":"2024-04-13T02:44:41.287186+0000","last_undegraded":"2024-04-13T02:44:41.287186+0000","last_fullsized":"2024-04-13T02:44:41.287186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230173+0000","last_change":"2024-04-13T02:44:40.239316+0000","last_active":"2024-04-13T02:44:41.230173+0000","last_peered":"2024-04-13T02:44:41.230173+0000","last_clean":"2024-04-13T02:44:41.230173+0000","last_became_active":"2024-04-13T02:44:40.238176+0000","last_became_peered":"2024-04-13T02:44:40.238176+0000","last_unstale":"2024-04-13T02:44:41.230173+0000","last_undegraded":"2024-04-13T02:44:41.230173+0000","last_fullsized":"2024-04-13T02:44:41.230173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:30:16.725686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230294+0000","last_change":"2024-04-13T02:44:40.237209+0000","last_active":"2024-04-13T02:44:41.230294+0000","last_peered":"2024-04-13T02:44:41.230294+0000","last_clean":"2024-04-13T02:44:41.230294+0000","last_became_active":"2024-04-13T02:44:40.236901+0000","last_became_peered":"2024-04-13T02:44:40.236901+0000","last_unstale":"2024-04-13T02:44:41.230294+0000","last_undegraded":"2024-04-13T02:44:41.230294+0000","last_fullsized":"2024-04-13T02:44:41.230294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229417+0000","last_change":"2024-04-13T02:44:40.237664+0000","last_active":"2024-04-13T02:44:41.229417+0000","last_peered":"2024-04-13T02:44:41.229417+0000","last_clean":"2024-04-13T02:44:41.229417+0000","last_became_active":"2024-04-13T02:44:40.237363+0000","last_became_peered":"2024-04-13T02:44:40.237363+0000","last_unstale":"2024-04-13T02:44:41.229417+0000","last_undegraded":"2024-04-13T02:44:41.229417+0000","last_fullsized":"2024-04-13T02:44:41.229417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231205+0000","last_change":"2024-04-13T02:44:40.225679+0000","last_active":"2024-04-13T02:44:41.231205+0000","last_peered":"2024-04-13T02:44:41.231205+0000","last_clean":"2024-04-13T02:44:41.231205+0000","last_became_active":"2024-04-13T02:44:40.225402+0000","last_became_peered":"2024-04-13T02:44:40.225402+0000","last_unstale":"2024-04-13T02:44:41.231205+0000","last_undegraded":"2024-04-13T02:44:41.231205+0000","last_fullsized":"2024-04-13T02:44:41.231205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:30.234347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287653+0000","last_change":"2024-04-13T02:44:40.226365+0000","last_active":"2024-04-13T02:44:41.287653+0000","last_peered":"2024-04-13T02:44:41.287653+0000","last_clean":"2024-04-13T02:44:41.287653+0000","last_became_active":"2024-04-13T02:44:40.226103+0000","last_became_peered":"2024-04-13T02:44:40.226103+0000","last_unstale":"2024-04-13T02:44:41.287653+0000","last_undegraded":"2024-04-13T02:44:41.287653+0000","last_fullsized":"2024-04-13T02:44:41.287653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286468+0000","last_change":"2024-04-13T02:44:40.228743+0000","last_active":"2024-04-13T02:44:41.286468+0000","last_peered":"2024-04-13T02:44:41.286468+0000","last_clean":"2024-04-13T02:44:41.286468+0000","last_became_active":"2024-04-13T02:44:40.228492+0000","last_became_peered":"2024-04-13T02:44:40.228492+0000","last_unstale":"2024-04-13T02:44:41.286468+0000","last_undegraded":"2024-04-13T02:44:41.286468+0000","last_fullsized":"2024-04-13T02:44:41.286468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:08:04.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223149+0000","last_change":"2024-04-13T02:44:40.225456+0000","last_active":"2024-04-13T02:44:41.223149+0000","last_peered":"2024-04-13T02:44:41.223149+0000","last_clean":"2024-04-13T02:44:41.223149+0000","last_became_active":"2024-04-13T02:44:40.225188+0000","last_became_peered":"2024-04-13T02:44:40.225188+0000","last_unstale":"2024-04-13T02:44:41.223149+0000","last_undegraded":"2024-04-13T02:44:41.223149+0000","last_fullsized":"2024-04-13T02:44:41.223149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286591+0000","last_change":"2024-04-13T02:44:40.237710+0000","last_active":"2024-04-13T02:44:41.286591+0000","last_peered":"2024-04-13T02:44:41.286591+0000","last_clean":"2024-04-13T02:44:41.286591+0000","last_became_active":"2024-04-13T02:44:40.237420+0000","last_became_peered":"2024-04-13T02:44:40.237420+0000","last_unstale":"2024-04-13T02:44:41.286591+0000","last_undegraded":"2024-04-13T02:44:41.286591+0000","last_fullsized":"2024-04-13T02:44:41.286591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287251+0000","last_change":"2024-04-13T02:44:40.236472+0000","last_active":"2024-04-13T02:44:41.287251+0000","last_peered":"2024-04-13T02:44:41.287251+0000","last_clean":"2024-04-13T02:44:41.287251+0000","last_became_active":"2024-04-13T02:44:40.236012+0000","last_became_peered":"2024-04-13T02:44:40.236012+0000","last_unstale":"2024-04-13T02:44:41.287251+0000","last_undegraded":"2024-04-13T02:44:41.287251+0000","last_fullsized":"2024-04-13T02:44:41.287251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:17:28.338011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286361+0000","last_change":"2024-04-13T02:44:40.224907+0000","last_active":"2024-04-13T02:44:41.286361+0000","last_peered":"2024-04-13T02:44:41.286361+0000","last_clean":"2024-04-13T02:44:41.286361+0000","last_became_active":"2024-04-13T02:44:40.224661+0000","last_became_peered":"2024-04-13T02:44:40.224661+0000","last_unstale":"2024-04-13T02:44:41.286361+0000","last_undegraded":"2024-04-13T02:44:41.286361+0000","last_fullsized":"2024-04-13T02:44:41.286361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:30.234347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229562+0000","last_change":"2024-04-13T02:44:40.227792+0000","last_active":"2024-04-13T02:44:41.229562+0000","last_peered":"2024-04-13T02:44:41.229562+0000","last_clean":"2024-04-13T02:44:41.229562+0000","last_became_active":"2024-04-13T02:44:40.227476+0000","last_became_peered":"2024-04-13T02:44:40.227476+0000","last_unstale":"2024-04-13T02:44:41.229562+0000","last_undegraded":"2024-04-13T02:44:41.229562+0000","last_fullsized":"2024-04-13T02:44:41.229562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:05.949674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228987+0000","last_change":"2024-04-13T02:44:40.227430+0000","last_active":"2024-04-13T02:44:41.228987+0000","last_peered":"2024-04-13T02:44:41.228987+0000","last_clean":"2024-04-13T02:44:41.228987+0000","last_became_active":"2024-04-13T02:44:40.226916+0000","last_became_peered":"2024-04-13T02:44:40.226916+0000","last_unstale":"2024-04-13T02:44:41.228987+0000","last_undegraded":"2024-04-13T02:44:41.228987+0000","last_fullsized":"2024-04-13T02:44:41.228987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286873+0000","last_change":"2024-04-13T02:44:40.229586+0000","last_active":"2024-04-13T02:44:41.286873+0000","last_peered":"2024-04-13T02:44:41.286873+0000","last_clean":"2024-04-13T02:44:41.286873+0000","last_became_active":"2024-04-13T02:44:40.229314+0000","last_became_peered":"2024-04-13T02:44:40.229314+0000","last_unstale":"2024-04-13T02:44:41.286873+0000","last_undegraded":"2024-04-13T02:44:41.286873+0000","last_fullsized":"2024-04-13T02:44:41.286873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:43:21.359238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286802+0000","last_change":"2024-04-13T02:44:40.241419+0000","last_active":"2024-04-13T02:44:41.286802+0000","last_peered":"2024-04-13T02:44:41.286802+0000","last_clean":"2024-04-13T02:44:41.286802+0000","last_became_active":"2024-04-13T02:44:40.241126+0000","last_became_peered":"2024-04-13T02:44:40.241126+0000","last_unstale":"2024-04-13T02:44:41.286802+0000","last_undegraded":"2024-04-13T02:44:41.286802+0000","last_fullsized":"2024-04-13T02:44:41.286802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:28:51.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287333+0000","last_change":"2024-04-13T02:44:40.231595+0000","last_active":"2024-04-13T02:44:41.287333+0000","last_peered":"2024-04-13T02:44:41.287333+0000","last_clean":"2024-04-13T02:44:41.287333+0000","last_became_active":"2024-04-13T02:44:40.231324+0000","last_became_peered":"2024-04-13T02:44:40.231324+0000","last_unstale":"2024-04-13T02:44:41.287333+0000","last_undegraded":"2024-04-13T02:44:41.287333+0000","last_fullsized":"2024-04-13T02:44:41.287333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286891+0000","last_change":"2024-04-13T02:44:40.233812+0000","last_active":"2024-04-13T02:44:41.286891+0000","last_peered":"2024-04-13T02:44:41.286891+0000","last_clean":"2024-04-13T02:44:41.286891+0000","last_became_active":"2024-04-13T02:44:40.233554+0000","last_became_peered":"2024-04-13T02:44:40.233554+0000","last_unstale":"2024-04-13T02:44:41.286891+0000","last_undegraded":"2024-04-13T02:44:41.286891+0000","last_fullsized":"2024-04-13T02:44:41.286891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:22:29.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287934+0000","last_change":"2024-04-13T02:44:40.227589+0000","last_active":"2024-04-13T02:44:41.287934+0000","last_peered":"2024-04-13T02:44:41.287934+0000","last_clean":"2024-04-13T02:44:41.287934+0000","last_became_active":"2024-04-13T02:44:40.227296+0000","last_became_peered":"2024-04-13T02:44:40.227296+0000","last_unstale":"2024-04-13T02:44:41.287934+0000","last_undegraded":"2024-04-13T02:44:41.287934+0000","last_fullsized":"2024-04-13T02:44:41.287934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230427+0000","last_change":"2024-04-13T02:44:40.230572+0000","last_active":"2024-04-13T02:44:41.230427+0000","last_peered":"2024-04-13T02:44:41.230427+0000","last_clean":"2024-04-13T02:44:41.230427+0000","last_became_active":"2024-04-13T02:44:40.230294+0000","last_became_peered":"2024-04-13T02:44:40.230294+0000","last_unstale":"2024-04-13T02:44:41.230427+0000","last_undegraded":"2024-04-13T02:44:41.230427+0000","last_fullsized":"2024-04-13T02:44:41.230427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223241+0000","last_change":"2024-04-13T02:44:40.225831+0000","last_active":"2024-04-13T02:44:41.223241+0000","last_peered":"2024-04-13T02:44:41.223241+0000","last_clean":"2024-04-13T02:44:41.223241+0000","last_became_active":"2024-04-13T02:44:40.225519+0000","last_became_peered":"2024-04-13T02:44:40.225519+0000","last_unstale":"2024-04-13T02:44:41.223241+0000","last_undegraded":"2024-04-13T02:44:41.223241+0000","last_fullsized":"2024-04-13T02:44:41.223241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287503+0000","last_change":"2024-04-13T02:44:40.231590+0000","last_active":"2024-04-13T02:44:41.287503+0000","last_peered":"2024-04-13T02:44:41.287503+0000","last_clean":"2024-04-13T02:44:41.287503+0000","last_became_active":"2024-04-13T02:44:40.231334+0000","last_became_peered":"2024-04-13T02:44:40.231334+0000","last_unstale":"2024-04-13T02:44:41.287503+0000","last_undegraded":"2024-04-13T02:44:41.287503+0000","last_fullsized":"2024-04-13T02:44:41.287503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286995+0000","last_change":"2024-04-13T02:44:40.227342+0000","last_active":"2024-04-13T02:44:41.286995+0000","last_peered":"2024-04-13T02:44:41.286995+0000","last_clean":"2024-04-13T02:44:41.286995+0000","last_became_active":"2024-04-13T02:44:40.227062+0000","last_became_peered":"2024-04-13T02:44:40.227062+0000","last_unstale":"2024-04-13T02:44:41.286995+0000","last_undegraded":"2024-04-13T02:44:41.286995+0000","last_fullsized":"2024-04-13T02:44:41.286995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287004+0000","last_change":"2024-04-13T02:44:40.232709+0000","last_active":"2024-04-13T02:44:41.287004+0000","last_peered":"2024-04-13T02:44:41.287004+0000","last_clean":"2024-04-13T02:44:41.287004+0000","last_became_active":"2024-04-13T02:44:40.232444+0000","last_became_peered":"2024-04-13T02:44:40.232444+0000","last_unstale":"2024-04-13T02:44:41.287004+0000","last_undegraded":"2024-04-13T02:44:41.287004+0000","last_fullsized":"2024-04-13T02:44:41.287004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:05.949674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286710+0000","last_change":"2024-04-13T02:44:40.239126+0000","last_active":"2024-04-13T02:44:41.286710+0000","last_peered":"2024-04-13T02:44:41.286710+0000","last_clean":"2024-04-13T02:44:41.286710+0000","last_became_active":"2024-04-13T02:44:40.238820+0000","last_became_peered":"2024-04-13T02:44:40.238820+0000","last_unstale":"2024-04-13T02:44:41.286710+0000","last_undegraded":"2024-04-13T02:44:41.286710+0000","last_fullsized":"2024-04-13T02:44:41.286710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:24.204040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228646+0000","last_change":"2024-04-13T02:44:40.225771+0000","last_active":"2024-04-13T02:44:41.228646+0000","last_peered":"2024-04-13T02:44:41.228646+0000","last_clean":"2024-04-13T02:44:41.228646+0000","last_became_active":"2024-04-13T02:44:40.225482+0000","last_became_peered":"2024-04-13T02:44:40.225482+0000","last_unstale":"2024-04-13T02:44:41.228646+0000","last_undegraded":"2024-04-13T02:44:41.228646+0000","last_fullsized":"2024-04-13T02:44:41.228646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:43:21.359238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231043+0000","last_change":"2024-04-13T02:44:40.228987+0000","last_active":"2024-04-13T02:44:41.231043+0000","last_peered":"2024-04-13T02:44:41.231043+0000","last_clean":"2024-04-13T02:44:41.231043+0000","last_became_active":"2024-04-13T02:44:40.228645+0000","last_became_peered":"2024-04-13T02:44:40.228645+0000","last_unstale":"2024-04-13T02:44:41.231043+0000","last_undegraded":"2024-04-13T02:44:41.231043+0000","last_fullsized":"2024-04-13T02:44:41.231043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:53.107374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287771+0000","last_change":"2024-04-13T02:44:39.214920+0000","last_active":"2024-04-13T02:44:41.287771+0000","last_peered":"2024-04-13T02:44:41.287771+0000","last_clean":"2024-04-13T02:44:41.287771+0000","last_became_active":"2024-04-13T02:44:39.213481+0000","last_became_peered":"2024-04-13T02:44:39.213481+0000","last_unstale":"2024-04-13T02:44:41.287771+0000","last_undegraded":"2024-04-13T02:44:41.287771+0000","last_fullsized":"2024-04-13T02:44:41.287771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287017+0000","last_change":"2024-04-13T02:44:40.227426+0000","last_active":"2024-04-13T02:44:41.287017+0000","last_peered":"2024-04-13T02:44:41.287017+0000","last_clean":"2024-04-13T02:44:41.287017+0000","last_became_active":"2024-04-13T02:44:40.226865+0000","last_became_peered":"2024-04-13T02:44:40.226865+0000","last_unstale":"2024-04-13T02:44:41.287017+0000","last_undegraded":"2024-04-13T02:44:41.287017+0000","last_fullsized":"2024-04-13T02:44:41.287017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228853+0000","last_change":"2024-04-13T02:44:39.216952+0000","last_active":"2024-04-13T02:44:41.228853+0000","last_peered":"2024-04-13T02:44:41.228853+0000","last_clean":"2024-04-13T02:44:41.228853+0000","last_became_active":"2024-04-13T02:44:39.216642+0000","last_became_peered":"2024-04-13T02:44:39.216642+0000","last_unstale":"2024-04-13T02:44:41.228853+0000","last_undegraded":"2024-04-13T02:44:41.228853+0000","last_fullsized":"2024-04-13T02:44:41.228853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287286+0000","last_change":"2024-04-13T02:44:39.215674+0000","last_active":"2024-04-13T02:44:41.287286+0000","last_peered":"2024-04-13T02:44:41.287286+0000","last_clean":"2024-04-13T02:44:41.287286+0000","last_became_active":"2024-04-13T02:44:39.215390+0000","last_became_peered":"2024-04-13T02:44:39.215390+0000","last_unstale":"2024-04-13T02:44:41.287286+0000","last_undegraded":"2024-04-13T02:44:41.287286+0000","last_fullsized":"2024-04-13T02:44:41.287286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287324+0000","last_change":"2024-04-13T02:44:40.224744+0000","last_active":"2024-04-13T02:44:41.287324+0000","last_peered":"2024-04-13T02:44:41.287324+0000","last_clean":"2024-04-13T02:44:41.287324+0000","last_became_active":"2024-04-13T02:44:40.224408+0000","last_became_peered":"2024-04-13T02:44:40.224408+0000","last_unstale":"2024-04-13T02:44:41.287324+0000","last_undegraded":"2024-04-13T02:44:41.287324+0000","last_fullsized":"2024-04-13T02:44:41.287324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286792+0000","last_change":"2024-04-13T02:44:39.222541+0000","last_active":"2024-04-13T02:44:41.286792+0000","last_peered":"2024-04-13T02:44:41.286792+0000","last_clean":"2024-04-13T02:44:41.286792+0000","last_became_active":"2024-04-13T02:44:39.222178+0000","last_became_peered":"2024-04-13T02:44:39.222178+0000","last_unstale":"2024-04-13T02:44:41.286792+0000","last_undegraded":"2024-04-13T02:44:41.286792+0000","last_fullsized":"2024-04-13T02:44:41.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223143+0000","last_change":"2024-04-13T02:44:40.229697+0000","last_active":"2024-04-13T02:44:41.223143+0000","last_peered":"2024-04-13T02:44:41.223143+0000","last_clean":"2024-04-13T02:44:41.223143+0000","last_became_active":"2024-04-13T02:44:40.228188+0000","last_became_peered":"2024-04-13T02:44:40.228188+0000","last_unstale":"2024-04-13T02:44:41.223143+0000","last_undegraded":"2024-04-13T02:44:41.223143+0000","last_fullsized":"2024-04-13T02:44:41.223143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229958+0000","last_change":"2024-04-13T02:44:39.224508+0000","last_active":"2024-04-13T02:44:41.229958+0000","last_peered":"2024-04-13T02:44:41.229958+0000","last_clean":"2024-04-13T02:44:41.229958+0000","last_became_active":"2024-04-13T02:44:39.224118+0000","last_became_peered":"2024-04-13T02:44:39.224118+0000","last_unstale":"2024-04-13T02:44:41.229958+0000","last_undegraded":"2024-04-13T02:44:41.229958+0000","last_fullsized":"2024-04-13T02:44:41.229958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287025+0000","last_change":"2024-04-13T02:44:40.232833+0000","last_active":"2024-04-13T02:44:41.287025+0000","last_peered":"2024-04-13T02:44:41.287025+0000","last_clean":"2024-04-13T02:44:41.287025+0000","last_became_active":"2024-04-13T02:44:40.232554+0000","last_became_peered":"2024-04-13T02:44:40.232554+0000","last_unstale":"2024-04-13T02:44:41.287025+0000","last_undegraded":"2024-04-13T02:44:41.287025+0000","last_fullsized":"2024-04-13T02:44:41.287025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:52:45.259162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286911+0000","last_change":"2024-04-13T02:44:39.223166+0000","last_active":"2024-04-13T02:44:41.286911+0000","last_peered":"2024-04-13T02:44:41.286911+0000","last_clean":"2024-04-13T02:44:41.286911+0000","last_became_active":"2024-04-13T02:44:39.222884+0000","last_became_peered":"2024-04-13T02:44:39.222884+0000","last_unstale":"2024-04-13T02:44:41.286911+0000","last_undegraded":"2024-04-13T02:44:41.286911+0000","last_fullsized":"2024-04-13T02:44:41.286911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287061+0000","last_change":"2024-04-13T02:44:40.237654+0000","last_active":"2024-04-13T02:44:41.287061+0000","last_peered":"2024-04-13T02:44:41.287061+0000","last_clean":"2024-04-13T02:44:41.287061+0000","last_became_active":"2024-04-13T02:44:40.237119+0000","last_became_peered":"2024-04-13T02:44:40.237119+0000","last_unstale":"2024-04-13T02:44:41.287061+0000","last_undegraded":"2024-04-13T02:44:41.287061+0000","last_fullsized":"2024-04-13T02:44:41.287061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223435+0000","last_change":"2024-04-13T02:44:39.221993+0000","last_active":"2024-04-13T02:44:41.223435+0000","last_peered":"2024-04-13T02:44:41.223435+0000","last_clean":"2024-04-13T02:44:41.223435+0000","last_became_active":"2024-04-13T02:44:39.221682+0000","last_became_peered":"2024-04-13T02:44:39.221682+0000","last_unstale":"2024-04-13T02:44:41.223435+0000","last_undegraded":"2024-04-13T02:44:41.223435+0000","last_fullsized":"2024-04-13T02:44:41.223435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:29.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231233+0000","last_change":"2024-04-13T02:44:40.229580+0000","last_active":"2024-04-13T02:44:41.231233+0000","last_peered":"2024-04-13T02:44:41.231233+0000","last_clean":"2024-04-13T02:44:41.231233+0000","last_became_active":"2024-04-13T02:44:40.229234+0000","last_became_peered":"2024-04-13T02:44:40.229234+0000","last_unstale":"2024-04-13T02:44:41.231233+0000","last_undegraded":"2024-04-13T02:44:41.231233+0000","last_fullsized":"2024-04-13T02:44:41.231233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:24.204040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229184+0000","last_change":"2024-04-13T02:44:39.220422+0000","last_active":"2024-04-13T02:44:41.229184+0000","last_peered":"2024-04-13T02:44:41.229184+0000","last_clean":"2024-04-13T02:44:41.229184+0000","last_became_active":"2024-04-13T02:44:39.220071+0000","last_became_peered":"2024-04-13T02:44:39.220071+0000","last_unstale":"2024-04-13T02:44:41.229184+0000","last_undegraded":"2024-04-13T02:44:41.229184+0000","last_fullsized":"2024-04-13T02:44:41.229184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229245+0000","last_change":"2024-04-13T02:44:40.226890+0000","last_active":"2024-04-13T02:44:41.229245+0000","last_peered":"2024-04-13T02:44:41.229245+0000","last_clean":"2024-04-13T02:44:41.229245+0000","last_became_active":"2024-04-13T02:44:40.224137+0000","last_became_peered":"2024-04-13T02:44:40.224137+0000","last_unstale":"2024-04-13T02:44:41.229245+0000","last_undegraded":"2024-04-13T02:44:41.229245+0000","last_fullsized":"2024-04-13T02:44:41.229245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287114+0000","last_change":"2024-04-13T02:44:39.215405+0000","last_active":"2024-04-13T02:44:41.287114+0000","last_peered":"2024-04-13T02:44:41.287114+0000","last_clean":"2024-04-13T02:44:41.287114+0000","last_became_active":"2024-04-13T02:44:39.215134+0000","last_became_peered":"2024-04-13T02:44:39.215134+0000","last_unstale":"2024-04-13T02:44:41.287114+0000","last_undegraded":"2024-04-13T02:44:41.287114+0000","last_fullsized":"2024-04-13T02:44:41.287114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:01:39.290126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286601+0000","last_change":"2024-04-13T02:44:40.236884+0000","last_active":"2024-04-13T02:44:41.286601+0000","last_peered":"2024-04-13T02:44:41.286601+0000","last_clean":"2024-04-13T02:44:41.286601+0000","last_became_active":"2024-04-13T02:44:40.236622+0000","last_became_peered":"2024-04-13T02:44:40.236622+0000","last_unstale":"2024-04-13T02:44:41.286601+0000","last_undegraded":"2024-04-13T02:44:41.286601+0000","last_fullsized":"2024-04-13T02:44:41.286601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:12:12.862195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286931+0000","last_change":"2024-04-13T02:44:39.222283+0000","last_active":"2024-04-13T02:44:41.286931+0000","last_peered":"2024-04-13T02:44:41.286931+0000","last_clean":"2024-04-13T02:44:41.286931+0000","last_became_active":"2024-04-13T02:44:39.222011+0000","last_became_peered":"2024-04-13T02:44:39.222011+0000","last_unstale":"2024-04-13T02:44:41.286931+0000","last_undegraded":"2024-04-13T02:44:41.286931+0000","last_fullsized":"2024-04-13T02:44:41.286931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230336+0000","last_change":"2024-04-13T02:44:40.226836+0000","last_active":"2024-04-13T02:44:41.230336+0000","last_peered":"2024-04-13T02:44:41.230336+0000","last_clean":"2024-04-13T02:44:41.230336+0000","last_became_active":"2024-04-13T02:44:40.226543+0000","last_became_peered":"2024-04-13T02:44:40.226543+0000","last_unstale":"2024-04-13T02:44:41.230336+0000","last_undegraded":"2024-04-13T02:44:41.230336+0000","last_fullsized":"2024-04-13T02:44:41.230336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:02:38.309228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228786+0000","last_change":"2024-04-13T02:44:39.217101+0000","last_active":"2024-04-13T02:44:41.228786+0000","last_peered":"2024-04-13T02:44:41.228786+0000","last_clean":"2024-04-13T02:44:41.228786+0000","last_became_active":"2024-04-13T02:44:39.216631+0000","last_became_peered":"2024-04-13T02:44:39.216631+0000","last_unstale":"2024-04-13T02:44:41.228786+0000","last_undegraded":"2024-04-13T02:44:41.228786+0000","last_fullsized":"2024-04-13T02:44:41.228786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228647+0000","last_change":"2024-04-13T02:44:40.227724+0000","last_active":"2024-04-13T02:44:41.228647+0000","last_peered":"2024-04-13T02:44:41.228647+0000","last_clean":"2024-04-13T02:44:41.228647+0000","last_became_active":"2024-04-13T02:44:40.226329+0000","last_became_peered":"2024-04-13T02:44:40.226329+0000","last_unstale":"2024-04-13T02:44:41.228647+0000","last_undegraded":"2024-04-13T02:44:41.228647+0000","last_fullsized":"2024-04-13T02:44:41.228647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286319+0000","last_change":"2024-04-13T02:44:39.220470+0000","last_active":"2024-04-13T02:44:41.286319+0000","last_peered":"2024-04-13T02:44:41.286319+0000","last_clean":"2024-04-13T02:44:41.286319+0000","last_became_active":"2024-04-13T02:44:39.220165+0000","last_became_peered":"2024-04-13T02:44:39.220165+0000","last_unstale":"2024-04-13T02:44:41.286319+0000","last_undegraded":"2024-04-13T02:44:41.286319+0000","last_fullsized":"2024-04-13T02:44:41.286319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230076+0000","last_change":"2024-04-13T02:44:40.226549+0000","last_active":"2024-04-13T02:44:41.230076+0000","last_peered":"2024-04-13T02:44:41.230076+0000","last_clean":"2024-04-13T02:44:41.230076+0000","last_became_active":"2024-04-13T02:44:40.223509+0000","last_became_peered":"2024-04-13T02:44:40.223509+0000","last_unstale":"2024-04-13T02:44:41.230076+0000","last_undegraded":"2024-04-13T02:44:41.230076+0000","last_fullsized":"2024-04-13T02:44:41.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:09:46.354760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231188+0000","last_change":"2024-04-13T02:44:39.213369+0000","last_active":"2024-04-13T02:44:41.231188+0000","last_peered":"2024-04-13T02:44:41.231188+0000","last_clean":"2024-04-13T02:44:41.231188+0000","last_became_active":"2024-04-13T02:44:39.213049+0000","last_became_peered":"2024-04-13T02:44:39.213049+0000","last_unstale":"2024-04-13T02:44:41.231188+0000","last_undegraded":"2024-04-13T02:44:41.231188+0000","last_fullsized":"2024-04-13T02:44:41.231188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:29:00.582843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229693+0000","last_change":"2024-04-13T02:44:40.227249+0000","last_active":"2024-04-13T02:44:41.229693+0000","last_peered":"2024-04-13T02:44:41.229693+0000","last_clean":"2024-04-13T02:44:41.229693+0000","last_became_active":"2024-04-13T02:44:40.226935+0000","last_became_peered":"2024-04-13T02:44:40.226935+0000","last_unstale":"2024-04-13T02:44:41.229693+0000","last_undegraded":"2024-04-13T02:44:41.229693+0000","last_fullsized":"2024-04-13T02:44:41.229693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:38:37.826515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286339+0000","last_change":"2024-04-13T02:44:39.219683+0000","last_active":"2024-04-13T02:44:41.286339+0000","last_peered":"2024-04-13T02:44:41.286339+0000","last_clean":"2024-04-13T02:44:41.286339+0000","last_became_active":"2024-04-13T02:44:39.219383+0000","last_became_peered":"2024-04-13T02:44:39.219383+0000","last_unstale":"2024-04-13T02:44:41.286339+0000","last_undegraded":"2024-04-13T02:44:41.286339+0000","last_fullsized":"2024-04-13T02:44:41.286339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230678+0000","last_change":"2024-04-13T02:44:40.229158+0000","last_active":"2024-04-13T02:44:41.230678+0000","last_peered":"2024-04-13T02:44:41.230678+0000","last_clean":"2024-04-13T02:44:41.230678+0000","last_became_active":"2024-04-13T02:44:40.226959+0000","last_became_peered":"2024-04-13T02:44:40.226959+0000","last_unstale":"2024-04-13T02:44:41.230678+0000","last_undegraded":"2024-04-13T02:44:41.230678+0000","last_fullsized":"2024-04-13T02:44:41.230678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:42:12.349502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223394+0000","last_change":"2024-04-13T02:44:39.219002+0000","last_active":"2024-04-13T02:44:41.223394+0000","last_peered":"2024-04-13T02:44:41.223394+0000","last_clean":"2024-04-13T02:44:41.223394+0000","last_became_active":"2024-04-13T02:44:39.218708+0000","last_became_peered":"2024-04-13T02:44:39.218708+0000","last_unstale":"2024-04-13T02:44:41.223394+0000","last_undegraded":"2024-04-13T02:44:41.223394+0000","last_fullsized":"2024-04-13T02:44:41.223394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:23.200046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286950+0000","last_change":"2024-04-13T02:44:40.233452+0000","last_active":"2024-04-13T02:44:41.286950+0000","last_peered":"2024-04-13T02:44:41.286950+0000","last_clean":"2024-04-13T02:44:41.286950+0000","last_became_active":"2024-04-13T02:44:40.233136+0000","last_became_peered":"2024-04-13T02:44:40.233136+0000","last_unstale":"2024-04-13T02:44:41.286950+0000","last_undegraded":"2024-04-13T02:44:41.286950+0000","last_fullsized":"2024-04-13T02:44:41.286950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286687+0000","last_change":"2024-04-13T02:44:39.224219+0000","last_active":"2024-04-13T02:44:41.286687+0000","last_peered":"2024-04-13T02:44:41.286687+0000","last_clean":"2024-04-13T02:44:41.286687+0000","last_became_active":"2024-04-13T02:44:39.223880+0000","last_became_peered":"2024-04-13T02:44:39.223880+0000","last_unstale":"2024-04-13T02:44:41.286687+0000","last_undegraded":"2024-04-13T02:44:41.286687+0000","last_fullsized":"2024-04-13T02:44:41.286687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229315+0000","last_change":"2024-04-13T02:44:40.237388+0000","last_active":"2024-04-13T02:44:41.229315+0000","last_peered":"2024-04-13T02:44:41.229315+0000","last_clean":"2024-04-13T02:44:41.229315+0000","last_became_active":"2024-04-13T02:44:40.237135+0000","last_became_peered":"2024-04-13T02:44:40.237135+0000","last_unstale":"2024-04-13T02:44:41.229315+0000","last_undegraded":"2024-04-13T02:44:41.229315+0000","last_fullsized":"2024-04-13T02:44:41.229315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229819+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:44:41.229819+0000","last_peered":"2024-04-13T02:44:41.229819+0000","last_clean":"2024-04-13T02:44:41.229819+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:44:41.229819+0000","last_undegraded":"2024-04-13T02:44:41.229819+0000","last_fullsized":"2024-04-13T02:44:41.229819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286679+0000","last_change":"2024-04-13T02:44:39.223022+0000","last_active":"2024-04-13T02:44:41.286679+0000","last_peered":"2024-04-13T02:44:41.286679+0000","last_clean":"2024-04-13T02:44:41.286679+0000","last_became_active":"2024-04-13T02:44:39.222581+0000","last_became_peered":"2024-04-13T02:44:39.222581+0000","last_unstale":"2024-04-13T02:44:41.286679+0000","last_undegraded":"2024-04-13T02:44:41.286679+0000","last_fullsized":"2024-04-13T02:44:41.286679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287663+0000","last_change":"2024-04-13T02:44:40.237625+0000","last_active":"2024-04-13T02:44:41.287663+0000","last_peered":"2024-04-13T02:44:41.287663+0000","last_clean":"2024-04-13T02:44:41.287663+0000","last_became_active":"2024-04-13T02:44:40.237335+0000","last_became_peered":"2024-04-13T02:44:40.237335+0000","last_unstale":"2024-04-13T02:44:41.287663+0000","last_undegraded":"2024-04-13T02:44:41.287663+0000","last_fullsized":"2024-04-13T02:44:41.287663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229759+0000","last_change":"2024-04-13T02:44:39.223819+0000","last_active":"2024-04-13T02:44:41.229759+0000","last_peered":"2024-04-13T02:44:41.229759+0000","last_clean":"2024-04-13T02:44:41.229759+0000","last_became_active":"2024-04-13T02:44:39.223502+0000","last_became_peered":"2024-04-13T02:44:39.223502+0000","last_unstale":"2024-04-13T02:44:41.229759+0000","last_undegraded":"2024-04-13T02:44:41.229759+0000","last_fullsized":"2024-04-13T02:44:41.229759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:23.200046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286745+0000","last_change":"2024-04-13T02:44:40.227306+0000","last_active":"2024-04-13T02:44:41.286745+0000","last_peered":"2024-04-13T02:44:41.286745+0000","last_clean":"2024-04-13T02:44:41.286745+0000","last_became_active":"2024-04-13T02:44:40.227034+0000","last_became_peered":"2024-04-13T02:44:40.227034+0000","last_unstale":"2024-04-13T02:44:41.286745+0000","last_undegraded":"2024-04-13T02:44:41.286745+0000","last_fullsized":"2024-04-13T02:44:41.286745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:12:10.847444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286791+0000","last_change":"2024-04-13T02:44:39.221174+0000","last_active":"2024-04-13T02:44:41.286791+0000","last_peered":"2024-04-13T02:44:41.286791+0000","last_clean":"2024-04-13T02:44:41.286791+0000","last_became_active":"2024-04-13T02:44:39.220885+0000","last_became_peered":"2024-04-13T02:44:39.220885+0000","last_unstale":"2024-04-13T02:44:41.286791+0000","last_undegraded":"2024-04-13T02:44:41.286791+0000","last_fullsized":"2024-04-13T02:44:41.286791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223245+0000","last_change":"2024-04-13T02:44:40.222634+0000","last_active":"2024-04-13T02:44:41.223245+0000","last_peered":"2024-04-13T02:44:41.223245+0000","last_clean":"2024-04-13T02:44:41.223245+0000","last_became_active":"2024-04-13T02:44:40.222243+0000","last_became_peered":"2024-04-13T02:44:40.222243+0000","last_unstale":"2024-04-13T02:44:41.223245+0000","last_undegraded":"2024-04-13T02:44:41.223245+0000","last_fullsized":"2024-04-13T02:44:41.223245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287055+0000","last_change":"2024-04-13T02:44:39.223485+0000","last_active":"2024-04-13T02:44:41.287055+0000","last_peered":"2024-04-13T02:44:41.287055+0000","last_clean":"2024-04-13T02:44:41.287055+0000","last_became_active":"2024-04-13T02:44:39.223163+0000","last_became_peered":"2024-04-13T02:44:39.223163+0000","last_unstale":"2024-04-13T02:44:41.287055+0000","last_undegraded":"2024-04-13T02:44:41.287055+0000","last_fullsized":"2024-04-13T02:44:41.287055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:43.259767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231172+0000","last_change":"2024-04-13T02:44:40.222929+0000","last_active":"2024-04-13T02:44:41.231172+0000","last_peered":"2024-04-13T02:44:41.231172+0000","last_clean":"2024-04-13T02:44:41.231172+0000","last_became_active":"2024-04-13T02:44:40.222596+0000","last_became_peered":"2024-04-13T02:44:40.222596+0000","last_unstale":"2024-04-13T02:44:41.231172+0000","last_undegraded":"2024-04-13T02:44:41.231172+0000","last_fullsized":"2024-04-13T02:44:41.231172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:44.263761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223367+0000","last_change":"2024-04-13T02:44:39.223044+0000","last_active":"2024-04-13T02:44:41.223367+0000","last_peered":"2024-04-13T02:44:41.223367+0000","last_clean":"2024-04-13T02:44:41.223367+0000","last_became_active":"2024-04-13T02:44:39.222291+0000","last_became_peered":"2024-04-13T02:44:39.222291+0000","last_unstale":"2024-04-13T02:44:41.223367+0000","last_undegraded":"2024-04-13T02:44:41.223367+0000","last_fullsized":"2024-04-13T02:44:41.223367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287274+0000","last_change":"2024-04-13T02:44:40.233688+0000","last_active":"2024-04-13T02:44:41.287274+0000","last_peered":"2024-04-13T02:44:41.287274+0000","last_clean":"2024-04-13T02:44:41.287274+0000","last_became_active":"2024-04-13T02:44:40.232532+0000","last_became_peered":"2024-04-13T02:44:40.232532+0000","last_unstale":"2024-04-13T02:44:41.287274+0000","last_undegraded":"2024-04-13T02:44:41.287274+0000","last_fullsized":"2024-04-13T02:44:41.287274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:09:46.354760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229734+0000","last_change":"2024-04-13T02:44:39.221704+0000","last_active":"2024-04-13T02:44:41.229734+0000","last_peered":"2024-04-13T02:44:41.229734+0000","last_clean":"2024-04-13T02:44:41.229734+0000","last_became_active":"2024-04-13T02:44:39.221381+0000","last_became_peered":"2024-04-13T02:44:39.221381+0000","last_unstale":"2024-04-13T02:44:41.229734+0000","last_undegraded":"2024-04-13T02:44:41.229734+0000","last_fullsized":"2024-04-13T02:44:41.229734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:12:11.858201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223232+0000","last_change":"2024-04-13T02:44:40.226440+0000","last_active":"2024-04-13T02:44:41.223232+0000","last_peered":"2024-04-13T02:44:41.223232+0000","last_clean":"2024-04-13T02:44:41.223232+0000","last_became_active":"2024-04-13T02:44:40.225635+0000","last_became_peered":"2024-04-13T02:44:40.225635+0000","last_unstale":"2024-04-13T02:44:41.223232+0000","last_undegraded":"2024-04-13T02:44:41.223232+0000","last_fullsized":"2024-04-13T02:44:41.223232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.227924+0000","last_change":"2024-04-13T02:44:39.222891+0000","last_active":"2024-04-13T02:44:41.227924+0000","last_peered":"2024-04-13T02:44:41.227924+0000","last_clean":"2024-04-13T02:44:41.227924+0000","last_became_active":"2024-04-13T02:44:39.222401+0000","last_became_peered":"2024-04-13T02:44:39.222401+0000","last_unstale":"2024-04-13T02:44:41.227924+0000","last_undegraded":"2024-04-13T02:44:41.227924+0000","last_fullsized":"2024-04-13T02:44:41.227924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.288052+0000","last_change":"2024-04-13T02:44:40.229666+0000","last_active":"2024-04-13T02:44:41.288052+0000","last_peered":"2024-04-13T02:44:41.288052+0000","last_clean":"2024-04-13T02:44:41.288052+0000","last_became_active":"2024-04-13T02:44:40.229394+0000","last_became_peered":"2024-04-13T02:44:40.229394+0000","last_unstale":"2024-04-13T02:44:41.288052+0000","last_undegraded":"2024-04-13T02:44:41.288052+0000","last_fullsized":"2024-04-13T02:44:41.288052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230066+0000","last_change":"2024-04-13T02:44:39.220188+0000","last_active":"2024-04-13T02:44:41.230066+0000","last_peered":"2024-04-13T02:44:41.230066+0000","last_clean":"2024-04-13T02:44:41.230066+0000","last_became_active":"2024-04-13T02:44:39.219872+0000","last_became_peered":"2024-04-13T02:44:39.219872+0000","last_unstale":"2024-04-13T02:44:41.230066+0000","last_undegraded":"2024-04-13T02:44:41.230066+0000","last_fullsized":"2024-04-13T02:44:41.230066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287012+0000","last_change":"2024-04-13T02:44:40.228870+0000","last_active":"2024-04-13T02:44:41.287012+0000","last_peered":"2024-04-13T02:44:41.287012+0000","last_clean":"2024-04-13T02:44:41.287012+0000","last_became_active":"2024-04-13T02:44:40.228525+0000","last_became_peered":"2024-04-13T02:44:40.228525+0000","last_unstale":"2024-04-13T02:44:41.287012+0000","last_undegraded":"2024-04-13T02:44:41.287012+0000","last_fullsized":"2024-04-13T02:44:41.287012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228895+0000","last_change":"2024-04-13T02:44:39.217842+0000","last_active":"2024-04-13T02:44:41.228895+0000","last_peered":"2024-04-13T02:44:41.228895+0000","last_clean":"2024-04-13T02:44:41.228895+0000","last_became_active":"2024-04-13T02:44:39.217486+0000","last_became_peered":"2024-04-13T02:44:39.217486+0000","last_unstale":"2024-04-13T02:44:41.228895+0000","last_undegraded":"2024-04-13T02:44:41.228895+0000","last_fullsized":"2024-04-13T02:44:41.228895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:29.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230940+0000","last_change":"2024-04-13T02:44:40.217868+0000","last_active":"2024-04-13T02:44:41.230940+0000","last_peered":"2024-04-13T02:44:41.230940+0000","last_clean":"2024-04-13T02:44:41.230940+0000","last_became_active":"2024-04-13T02:44:40.217588+0000","last_became_peered":"2024-04-13T02:44:40.217588+0000","last_unstale":"2024-04-13T02:44:41.230940+0000","last_undegraded":"2024-04-13T02:44:41.230940+0000","last_fullsized":"2024-04-13T02:44:41.230940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:01.746931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223252+0000","last_change":"2024-04-13T02:44:39.220393+0000","last_active":"2024-04-13T02:44:41.223252+0000","last_peered":"2024-04-13T02:44:41.223252+0000","last_clean":"2024-04-13T02:44:41.223252+0000","last_became_active":"2024-04-13T02:44:39.220122+0000","last_became_peered":"2024-04-13T02:44:39.220122+0000","last_unstale":"2024-04-13T02:44:41.223252+0000","last_undegraded":"2024-04-13T02:44:41.223252+0000","last_fullsized":"2024-04-13T02:44:41.223252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:43.259767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287456+0000","last_change":"2024-04-13T02:44:40.227423+0000","last_active":"2024-04-13T02:44:41.287456+0000","last_peered":"2024-04-13T02:44:41.287456+0000","last_clean":"2024-04-13T02:44:41.287456+0000","last_became_active":"2024-04-13T02:44:40.227151+0000","last_became_peered":"2024-04-13T02:44:40.227151+0000","last_unstale":"2024-04-13T02:44:41.287456+0000","last_undegraded":"2024-04-13T02:44:41.287456+0000","last_fullsized":"2024-04-13T02:44:41.287456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223304+0000","last_change":"2024-04-13T02:44:39.222583+0000","last_active":"2024-04-13T02:44:41.223304+0000","last_peered":"2024-04-13T02:44:41.223304+0000","last_clean":"2024-04-13T02:44:41.223304+0000","last_became_active":"2024-04-13T02:44:39.222307+0000","last_became_peered":"2024-04-13T02:44:39.222307+0000","last_unstale":"2024-04-13T02:44:41.223304+0000","last_undegraded":"2024-04-13T02:44:41.223304+0000","last_fullsized":"2024-04-13T02:44:41.223304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287720+0000","last_change":"2024-04-13T02:44:40.223063+0000","last_active":"2024-04-13T02:44:41.287720+0000","last_peered":"2024-04-13T02:44:41.287720+0000","last_clean":"2024-04-13T02:44:41.287720+0000","last_became_active":"2024-04-13T02:44:40.222790+0000","last_became_peered":"2024-04-13T02:44:40.222790+0000","last_unstale":"2024-04-13T02:44:41.287720+0000","last_undegraded":"2024-04-13T02:44:41.287720+0000","last_fullsized":"2024-04-13T02:44:41.287720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:22:29.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230357+0000","last_change":"2024-04-13T02:44:39.215575+0000","last_active":"2024-04-13T02:44:41.230357+0000","last_peered":"2024-04-13T02:44:41.230357+0000","last_clean":"2024-04-13T02:44:41.230357+0000","last_became_active":"2024-04-13T02:44:39.215199+0000","last_became_peered":"2024-04-13T02:44:39.215199+0000","last_unstale":"2024-04-13T02:44:41.230357+0000","last_undegraded":"2024-04-13T02:44:41.230357+0000","last_fullsized":"2024-04-13T02:44:41.230357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:17:32.443063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228884+0000","last_change":"2024-04-13T02:44:40.226463+0000","last_active":"2024-04-13T02:44:41.228884+0000","last_peered":"2024-04-13T02:44:41.228884+0000","last_clean":"2024-04-13T02:44:41.228884+0000","last_became_active":"2024-04-13T02:44:40.226185+0000","last_became_peered":"2024-04-13T02:44:40.226185+0000","last_unstale":"2024-04-13T02:44:41.228884+0000","last_undegraded":"2024-04-13T02:44:41.228884+0000","last_fullsized":"2024-04-13T02:44:41.228884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287104+0000","last_change":"2024-04-13T02:44:40.238975+0000","last_active":"2024-04-13T02:44:41.287104+0000","last_peered":"2024-04-13T02:44:41.287104+0000","last_clean":"2024-04-13T02:44:41.287104+0000","last_became_active":"2024-04-13T02:44:40.238416+0000","last_became_peered":"2024-04-13T02:44:40.238416+0000","last_unstale":"2024-04-13T02:44:41.287104+0000","last_undegraded":"2024-04-13T02:44:41.287104+0000","last_fullsized":"2024-04-13T02:44:41.287104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:38:37.826515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229450+0000","last_change":"2024-04-13T02:44:39.224883+0000","last_active":"2024-04-13T02:44:41.229450+0000","last_peered":"2024-04-13T02:44:41.229450+0000","last_clean":"2024-04-13T02:44:41.229450+0000","last_became_active":"2024-04-13T02:44:39.224587+0000","last_became_peered":"2024-04-13T02:44:39.224587+0000","last_unstale":"2024-04-13T02:44:41.229450+0000","last_undegraded":"2024-04-13T02:44:41.229450+0000","last_fullsized":"2024-04-13T02:44:41.229450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:43:18.401558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286778+0000","last_change":"2024-04-13T02:44:40.239119+0000","last_active":"2024-04-13T02:44:41.286778+0000","last_peered":"2024-04-13T02:44:41.286778+0000","last_clean":"2024-04-13T02:44:41.286778+0000","last_became_active":"2024-04-13T02:44:40.238841+0000","last_became_peered":"2024-04-13T02:44:40.238841+0000","last_unstale":"2024-04-13T02:44:41.286778+0000","last_undegraded":"2024-04-13T02:44:41.286778+0000","last_fullsized":"2024-04-13T02:44:41.286778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229347+0000","last_change":"2024-04-13T02:44:39.219315+0000","last_active":"2024-04-13T02:44:41.229347+0000","last_peered":"2024-04-13T02:44:41.229347+0000","last_clean":"2024-04-13T02:44:41.229347+0000","last_became_active":"2024-04-13T02:44:39.218997+0000","last_became_peered":"2024-04-13T02:44:39.218997+0000","last_unstale":"2024-04-13T02:44:41.229347+0000","last_undegraded":"2024-04-13T02:44:41.229347+0000","last_fullsized":"2024-04-13T02:44:41.229347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:08:03.429097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287022+0000","last_change":"2024-04-13T02:44:40.237798+0000","last_active":"2024-04-13T02:44:41.287022+0000","last_peered":"2024-04-13T02:44:41.287022+0000","last_clean":"2024-04-13T02:44:41.287022+0000","last_became_active":"2024-04-13T02:44:40.237420+0000","last_became_peered":"2024-04-13T02:44:40.237420+0000","last_unstale":"2024-04-13T02:44:41.287022+0000","last_undegraded":"2024-04-13T02:44:41.287022+0000","last_fullsized":"2024-04-13T02:44:41.287022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287851+0000","last_change":"2024-04-13T02:44:39.216773+0000","last_active":"2024-04-13T02:44:41.287851+0000","last_peered":"2024-04-13T02:44:41.287851+0000","last_clean":"2024-04-13T02:44:41.287851+0000","last_became_active":"2024-04-13T02:44:39.216483+0000","last_became_peered":"2024-04-13T02:44:39.216483+0000","last_unstale":"2024-04-13T02:44:41.287851+0000","last_undegraded":"2024-04-13T02:44:41.287851+0000","last_fullsized":"2024-04-13T02:44:41.287851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:36:17.093697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287891+0000","last_change":"2024-04-13T02:44:40.225518+0000","last_active":"2024-04-13T02:44:41.287891+0000","last_peered":"2024-04-13T02:44:41.287891+0000","last_clean":"2024-04-13T02:44:41.287891+0000","last_became_active":"2024-04-13T02:44:40.225251+0000","last_became_peered":"2024-04-13T02:44:40.225251+0000","last_unstale":"2024-04-13T02:44:41.287891+0000","last_undegraded":"2024-04-13T02:44:41.287891+0000","last_fullsized":"2024-04-13T02:44:41.287891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:28:51.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287116+0000","last_change":"2024-04-13T02:44:39.224484+0000","last_active":"2024-04-13T02:44:41.287116+0000","last_peered":"2024-04-13T02:44:41.287116+0000","last_clean":"2024-04-13T02:44:41.287116+0000","last_became_active":"2024-04-13T02:44:39.224147+0000","last_became_peered":"2024-04-13T02:44:39.224147+0000","last_unstale":"2024-04-13T02:44:41.287116+0000","last_undegraded":"2024-04-13T02:44:41.287116+0000","last_fullsized":"2024-04-13T02:44:41.287116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:36:17.093697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:44:47.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:44:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.677+0000 7f17e4be0640 1 Processor -- start 2024-04-13T02:44:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.677+0000 7f17e4be0640 1 -- start start 2024-04-13T02:44:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.678+0000 7f17e4be0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17e00cedf0 0x7f17e009b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.678+0000 7f17e4be0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e00c95e0 con 0x7f17e009b1e0 2024-04-13T02:44:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.678+0000 7f17e4be0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e00d0320 con 0x7f17e009ae00 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.678+0000 7f17e4be0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f17e0160520 con 0x7f17e00cedf0 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ddd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17e00cedf0 0x7f17e009b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ded9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f17e009b1e0 0x7f17e00cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58986/0 (socket says 172.21.15.114:58986) 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ded9d640 1 -- 172.21.15.114:0/2085860142 learned_addr learned my addr 172.21.15.114:0/2085860142 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ddd9b640 1 --2- 172.21.15.114:0/2085860142 >> v2:172.21.15.114:3300/0 conn(0x7f17e00cedf0 0x7f17e009b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53160/0 (socket says 172.21.15.114:53160) 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ddd9b640 1 -- 172.21.15.114:0/2085860142 >> v1:172.21.15.130:6789/0 conn(0x7f17e009ae00 legacy=0x7f17e00cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ddd9b640 1 -- 172.21.15.114:0/2085860142 >> v1:172.21.15.114:6789/0 conn(0x7f17e009b1e0 legacy=0x7f17e00cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17dd59a640 1 -- 172.21.15.114:0/2085860142 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747030136 0 0) 0x7f17e00c95e0 con 0x7f17e009b1e0 2024-04-13T02:44:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.679+0000 7f17ddd9b640 1 -- 172.21.15.114:0/2085860142 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e00d05e0 con 0x7f17e00cedf0 2024-04-13T02:44:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17ddd9b640 1 --2- 172.21.15.114:0/2085860142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e009b970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17d40097a0 tx=0x7f17d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf61a021a75eb41 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17dd59a640 1 -- 172.21.15.114:0/2085860142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d40315a0 con 0x7f17e00cedf0 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17dd59a640 1 -- 172.21.15.114:0/2085860142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d4037070 con 0x7f17e00cedf0 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17dd59a640 1 -- 172.21.15.114:0/2085860142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4031960 con 0x7f17e00cedf0 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 -- 172.21.15.114:0/2085860142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 msgr2=0x7f17e009b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2085860142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e009b970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17d40097a0 tx=0x7f17d402b840 comp rx=0 tx=0).stop 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 -- 172.21.15.114:0/2085860142 shutdown_connections 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2085860142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e009b970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 -- 172.21.15.114:0/2085860142 >> 172.21.15.114:0/2085860142 conn(0x7f17e00d2750 msgr2=0x7f17e00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 -- 172.21.15.114:0/2085860142 shutdown_connections 2024-04-13T02:44:47.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.680+0000 7f17e4be0640 1 -- 172.21.15.114:0/2085860142 wait complete. 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 Processor -- start 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 -- start start 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e009ae00 0x7f17e00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e009b1e0 0x7f17e015ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17e0160f70 con 0x7f17e00cedf0 2024-04-13T02:44:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f17e0160770 con 0x7f17e009ae00 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17e4be0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f17e01610f0 con 0x7f17e009b1e0 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17ded9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17ded9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e015f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53176/0 (socket says 172.21.15.114:53176) 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.682+0000 7f17ded9d640 1 -- 172.21.15.114:0/2300412936 learned_addr learned my addr 172.21.15.114:0/2300412936 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17de59c640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e009ae00 0x7f17e00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ddd9b640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e009b1e0 0x7f17e015ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ded9d640 1 -- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e009b1e0 msgr2=0x7f17e015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ded9d640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e009b1e0 0x7f17e015ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ded9d640 1 -- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e009ae00 msgr2=0x7f17e00c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ded9d640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e009ae00 0x7f17e00c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ded9d640 1 -- 172.21.15.114:0/2300412936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e00b5e80 con 0x7f17e00cedf0 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17de59c640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e009ae00 0x7f17e00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ded9d640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e015f140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c480 tx=0x7f17d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:47.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8018070 con 0x7f17e00cedf0 2024-04-13T02:44:47.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d8007500 con 0x7f17e00cedf0 2024-04-13T02:44:47.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e00b6160 con 0x7f17e00cedf0 2024-04-13T02:44:47.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8004a20 con 0x7f17e00cedf0 2024-04-13T02:44:47.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.683+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e00b6720 con 0x7f17e00cedf0 2024-04-13T02:44:47.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.684+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e0068c80 con 0x7f17e00cedf0 2024-04-13T02:44:47.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.684+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17d801b070 con 0x7f17e00cedf0 2024-04-13T02:44:47.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.685+0000 7f17ceffd640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f17c006c8f0 0x7f17c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:47.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.685+0000 7f17de59c640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f17c006c8f0 0x7f17c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:47.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.685+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f17d808ae30 con 0x7f17e00cedf0 2024-04-13T02:44:47.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.685+0000 7f17de59c640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f17c006c8f0 0x7f17c006edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17d0001e50 tx=0x7f17d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:47.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.689+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17d80593b0 con 0x7f17e00cedf0 2024-04-13T02:44:47.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.861+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17e015fe60 con 0x7f17c006c8f0 2024-04-13T02:44:47.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.867+0000 7f17ceffd640 1 -- 172.21.15.114:0/2300412936 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f17e015fe60 con 0x7f17c006c8f0 2024-04-13T02:44:47.871 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:47.872 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f17c006c8f0 msgr2=0x7f17c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f17c006c8f0 0x7f17c006edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17d0001e50 tx=0x7f17d0009040 comp rx=0 tx=0).stop 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 msgr2=0x7f17e015f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e015f140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c480 tx=0x7f17d800c940 comp rx=0 tx=0).stop 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 shutdown_connections 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17e00cedf0 0x7f17e015f140 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f17c006c8f0 0x7f17c006edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e009b1e0 0x7f17e015ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 --2- 172.21.15.114:0/2300412936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e009ae00 0x7f17e00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:47.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 >> 172.21.15.114:0/2300412936 conn(0x7f17e00d2750 msgr2=0x7f17e015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:47.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 shutdown_connections 2024-04-13T02:44:47.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:47.870+0000 7f17e4be0640 1 -- 172.21.15.114:0/2300412936 wait complete. 2024-04-13T02:44:47.882 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-13T02:44:47.489853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002593"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229767+0000","last_change":"2024-04-13T02:44:40.230633+0000","last_active":"2024-04-13T02:44:41.229767+0000","last_peered":"2024-04-13T02:44:41.229767+0000","last_clean":"2024-04-13T02:44:41.229767+0000","last_became_active":"2024-04-13T02:44:40.229553+0000","last_became_peered":"2024-04-13T02:44:40.229553+0000","last_unstale":"2024-04-13T02:44:41.229767+0000","last_undegraded":"2024-04-13T02:44:41.229767+0000","last_fullsized":"2024-04-13T02:44:41.229767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:17:28.338011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223475+0000","last_change":"2024-04-13T02:44:40.222537+0000","last_active":"2024-04-13T02:44:41.223475+0000","last_peered":"2024-04-13T02:44:41.223475+0000","last_clean":"2024-04-13T02:44:41.223475+0000","last_became_active":"2024-04-13T02:44:40.222285+0000","last_became_peered":"2024-04-13T02:44:40.222285+0000","last_unstale":"2024-04-13T02:44:41.223475+0000","last_undegraded":"2024-04-13T02:44:41.223475+0000","last_fullsized":"2024-04-13T02:44:41.223475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286895+0000","last_change":"2024-04-13T02:44:40.224528+0000","last_active":"2024-04-13T02:44:41.286895+0000","last_peered":"2024-04-13T02:44:41.286895+0000","last_clean":"2024-04-13T02:44:41.286895+0000","last_became_active":"2024-04-13T02:44:40.224212+0000","last_became_peered":"2024-04-13T02:44:40.224212+0000","last_unstale":"2024-04-13T02:44:41.286895+0000","last_undegraded":"2024-04-13T02:44:41.286895+0000","last_fullsized":"2024-04-13T02:44:41.286895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286877+0000","last_change":"2024-04-13T02:44:40.236982+0000","last_active":"2024-04-13T02:44:41.286877+0000","last_peered":"2024-04-13T02:44:41.286877+0000","last_clean":"2024-04-13T02:44:41.286877+0000","last_became_active":"2024-04-13T02:44:40.236331+0000","last_became_peered":"2024-04-13T02:44:40.236331+0000","last_unstale":"2024-04-13T02:44:41.286877+0000","last_undegraded":"2024-04-13T02:44:41.286877+0000","last_fullsized":"2024-04-13T02:44:41.286877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230228+0000","last_change":"2024-04-13T02:44:40.219544+0000","last_active":"2024-04-13T02:44:41.230228+0000","last_peered":"2024-04-13T02:44:41.230228+0000","last_clean":"2024-04-13T02:44:41.230228+0000","last_became_active":"2024-04-13T02:44:40.219255+0000","last_became_peered":"2024-04-13T02:44:40.219255+0000","last_unstale":"2024-04-13T02:44:41.230228+0000","last_undegraded":"2024-04-13T02:44:41.230228+0000","last_fullsized":"2024-04-13T02:44:41.230228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:56:10.757469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286700+0000","last_change":"2024-04-13T02:44:40.238704+0000","last_active":"2024-04-13T02:44:41.286700+0000","last_peered":"2024-04-13T02:44:41.286700+0000","last_clean":"2024-04-13T02:44:41.286700+0000","last_became_active":"2024-04-13T02:44:40.238452+0000","last_became_peered":"2024-04-13T02:44:40.238452+0000","last_unstale":"2024-04-13T02:44:41.286700+0000","last_undegraded":"2024-04-13T02:44:41.286700+0000","last_fullsized":"2024-04-13T02:44:41.286700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229704+0000","last_change":"2024-04-13T02:44:40.226014+0000","last_active":"2024-04-13T02:44:41.229704+0000","last_peered":"2024-04-13T02:44:41.229704+0000","last_clean":"2024-04-13T02:44:41.229704+0000","last_became_active":"2024-04-13T02:44:40.223159+0000","last_became_peered":"2024-04-13T02:44:40.223159+0000","last_unstale":"2024-04-13T02:44:41.229704+0000","last_undegraded":"2024-04-13T02:44:41.229704+0000","last_fullsized":"2024-04-13T02:44:41.229704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:52:45.259162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287186+0000","last_change":"2024-04-13T02:44:40.238313+0000","last_active":"2024-04-13T02:44:41.287186+0000","last_peered":"2024-04-13T02:44:41.287186+0000","last_clean":"2024-04-13T02:44:41.287186+0000","last_became_active":"2024-04-13T02:44:40.238050+0000","last_became_peered":"2024-04-13T02:44:40.238050+0000","last_unstale":"2024-04-13T02:44:41.287186+0000","last_undegraded":"2024-04-13T02:44:41.287186+0000","last_fullsized":"2024-04-13T02:44:41.287186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230173+0000","last_change":"2024-04-13T02:44:40.239316+0000","last_active":"2024-04-13T02:44:41.230173+0000","last_peered":"2024-04-13T02:44:41.230173+0000","last_clean":"2024-04-13T02:44:41.230173+0000","last_became_active":"2024-04-13T02:44:40.238176+0000","last_became_peered":"2024-04-13T02:44:40.238176+0000","last_unstale":"2024-04-13T02:44:41.230173+0000","last_undegraded":"2024-04-13T02:44:41.230173+0000","last_fullsized":"2024-04-13T02:44:41.230173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:30:16.725686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230294+0000","last_change":"2024-04-13T02:44:40.237209+0000","last_active":"2024-04-13T02:44:41.230294+0000","last_peered":"2024-04-13T02:44:41.230294+0000","last_clean":"2024-04-13T02:44:41.230294+0000","last_became_active":"2024-04-13T02:44:40.236901+0000","last_became_peered":"2024-04-13T02:44:40.236901+0000","last_unstale":"2024-04-13T02:44:41.230294+0000","last_undegraded":"2024-04-13T02:44:41.230294+0000","last_fullsized":"2024-04-13T02:44:41.230294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229417+0000","last_change":"2024-04-13T02:44:40.237664+0000","last_active":"2024-04-13T02:44:41.229417+0000","last_peered":"2024-04-13T02:44:41.229417+0000","last_clean":"2024-04-13T02:44:41.229417+0000","last_became_active":"2024-04-13T02:44:40.237363+0000","last_became_peered":"2024-04-13T02:44:40.237363+0000","last_unstale":"2024-04-13T02:44:41.229417+0000","last_undegraded":"2024-04-13T02:44:41.229417+0000","last_fullsized":"2024-04-13T02:44:41.229417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231205+0000","last_change":"2024-04-13T02:44:40.225679+0000","last_active":"2024-04-13T02:44:41.231205+0000","last_peered":"2024-04-13T02:44:41.231205+0000","last_clean":"2024-04-13T02:44:41.231205+0000","last_became_active":"2024-04-13T02:44:40.225402+0000","last_became_peered":"2024-04-13T02:44:40.225402+0000","last_unstale":"2024-04-13T02:44:41.231205+0000","last_undegraded":"2024-04-13T02:44:41.231205+0000","last_fullsized":"2024-04-13T02:44:41.231205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:30.234347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287653+0000","last_change":"2024-04-13T02:44:40.226365+0000","last_active":"2024-04-13T02:44:41.287653+0000","last_peered":"2024-04-13T02:44:41.287653+0000","last_clean":"2024-04-13T02:44:41.287653+0000","last_became_active":"2024-04-13T02:44:40.226103+0000","last_became_peered":"2024-04-13T02:44:40.226103+0000","last_unstale":"2024-04-13T02:44:41.287653+0000","last_undegraded":"2024-04-13T02:44:41.287653+0000","last_fullsized":"2024-04-13T02:44:41.287653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286468+0000","last_change":"2024-04-13T02:44:40.228743+0000","last_active":"2024-04-13T02:44:41.286468+0000","last_peered":"2024-04-13T02:44:41.286468+0000","last_clean":"2024-04-13T02:44:41.286468+0000","last_became_active":"2024-04-13T02:44:40.228492+0000","last_became_peered":"2024-04-13T02:44:40.228492+0000","last_unstale":"2024-04-13T02:44:41.286468+0000","last_undegraded":"2024-04-13T02:44:41.286468+0000","last_fullsized":"2024-04-13T02:44:41.286468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:08:04.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223149+0000","last_change":"2024-04-13T02:44:40.225456+0000","last_active":"2024-04-13T02:44:41.223149+0000","last_peered":"2024-04-13T02:44:41.223149+0000","last_clean":"2024-04-13T02:44:41.223149+0000","last_became_active":"2024-04-13T02:44:40.225188+0000","last_became_peered":"2024-04-13T02:44:40.225188+0000","last_unstale":"2024-04-13T02:44:41.223149+0000","last_undegraded":"2024-04-13T02:44:41.223149+0000","last_fullsized":"2024-04-13T02:44:41.223149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286591+0000","last_change":"2024-04-13T02:44:40.237710+0000","last_active":"2024-04-13T02:44:41.286591+0000","last_peered":"2024-04-13T02:44:41.286591+0000","last_clean":"2024-04-13T02:44:41.286591+0000","last_became_active":"2024-04-13T02:44:40.237420+0000","last_became_peered":"2024-04-13T02:44:40.237420+0000","last_unstale":"2024-04-13T02:44:41.286591+0000","last_undegraded":"2024-04-13T02:44:41.286591+0000","last_fullsized":"2024-04-13T02:44:41.286591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287251+0000","last_change":"2024-04-13T02:44:40.236472+0000","last_active":"2024-04-13T02:44:41.287251+0000","last_peered":"2024-04-13T02:44:41.287251+0000","last_clean":"2024-04-13T02:44:41.287251+0000","last_became_active":"2024-04-13T02:44:40.236012+0000","last_became_peered":"2024-04-13T02:44:40.236012+0000","last_unstale":"2024-04-13T02:44:41.287251+0000","last_undegraded":"2024-04-13T02:44:41.287251+0000","last_fullsized":"2024-04-13T02:44:41.287251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:17:28.338011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286361+0000","last_change":"2024-04-13T02:44:40.224907+0000","last_active":"2024-04-13T02:44:41.286361+0000","last_peered":"2024-04-13T02:44:41.286361+0000","last_clean":"2024-04-13T02:44:41.286361+0000","last_became_active":"2024-04-13T02:44:40.224661+0000","last_became_peered":"2024-04-13T02:44:40.224661+0000","last_unstale":"2024-04-13T02:44:41.286361+0000","last_undegraded":"2024-04-13T02:44:41.286361+0000","last_fullsized":"2024-04-13T02:44:41.286361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:30.234347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229562+0000","last_change":"2024-04-13T02:44:40.227792+0000","last_active":"2024-04-13T02:44:41.229562+0000","last_peered":"2024-04-13T02:44:41.229562+0000","last_clean":"2024-04-13T02:44:41.229562+0000","last_became_active":"2024-04-13T02:44:40.227476+0000","last_became_peered":"2024-04-13T02:44:40.227476+0000","last_unstale":"2024-04-13T02:44:41.229562+0000","last_undegraded":"2024-04-13T02:44:41.229562+0000","last_fullsized":"2024-04-13T02:44:41.229562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:05.949674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228987+0000","last_change":"2024-04-13T02:44:40.227430+0000","last_active":"2024-04-13T02:44:41.228987+0000","last_peered":"2024-04-13T02:44:41.228987+0000","last_clean":"2024-04-13T02:44:41.228987+0000","last_became_active":"2024-04-13T02:44:40.226916+0000","last_became_peered":"2024-04-13T02:44:40.226916+0000","last_unstale":"2024-04-13T02:44:41.228987+0000","last_undegraded":"2024-04-13T02:44:41.228987+0000","last_fullsized":"2024-04-13T02:44:41.228987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286873+0000","last_change":"2024-04-13T02:44:40.229586+0000","last_active":"2024-04-13T02:44:41.286873+0000","last_peered":"2024-04-13T02:44:41.286873+0000","last_clean":"2024-04-13T02:44:41.286873+0000","last_became_active":"2024-04-13T02:44:40.229314+0000","last_became_peered":"2024-04-13T02:44:40.229314+0000","last_unstale":"2024-04-13T02:44:41.286873+0000","last_undegraded":"2024-04-13T02:44:41.286873+0000","last_fullsized":"2024-04-13T02:44:41.286873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:43:21.359238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286802+0000","last_change":"2024-04-13T02:44:40.241419+0000","last_active":"2024-04-13T02:44:41.286802+0000","last_peered":"2024-04-13T02:44:41.286802+0000","last_clean":"2024-04-13T02:44:41.286802+0000","last_became_active":"2024-04-13T02:44:40.241126+0000","last_became_peered":"2024-04-13T02:44:40.241126+0000","last_unstale":"2024-04-13T02:44:41.286802+0000","last_undegraded":"2024-04-13T02:44:41.286802+0000","last_fullsized":"2024-04-13T02:44:41.286802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:28:51.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287333+0000","last_change":"2024-04-13T02:44:40.231595+0000","last_active":"2024-04-13T02:44:41.287333+0000","last_peered":"2024-04-13T02:44:41.287333+0000","last_clean":"2024-04-13T02:44:41.287333+0000","last_became_active":"2024-04-13T02:44:40.231324+0000","last_became_peered":"2024-04-13T02:44:40.231324+0000","last_unstale":"2024-04-13T02:44:41.287333+0000","last_undegraded":"2024-04-13T02:44:41.287333+0000","last_fullsized":"2024-04-13T02:44:41.287333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286891+0000","last_change":"2024-04-13T02:44:40.233812+0000","last_active":"2024-04-13T02:44:41.286891+0000","last_peered":"2024-04-13T02:44:41.286891+0000","last_clean":"2024-04-13T02:44:41.286891+0000","last_became_active":"2024-04-13T02:44:40.233554+0000","last_became_peered":"2024-04-13T02:44:40.233554+0000","last_unstale":"2024-04-13T02:44:41.286891+0000","last_undegraded":"2024-04-13T02:44:41.286891+0000","last_fullsized":"2024-04-13T02:44:41.286891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:22:29.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287934+0000","last_change":"2024-04-13T02:44:40.227589+0000","last_active":"2024-04-13T02:44:41.287934+0000","last_peered":"2024-04-13T02:44:41.287934+0000","last_clean":"2024-04-13T02:44:41.287934+0000","last_became_active":"2024-04-13T02:44:40.227296+0000","last_became_peered":"2024-04-13T02:44:40.227296+0000","last_unstale":"2024-04-13T02:44:41.287934+0000","last_undegraded":"2024-04-13T02:44:41.287934+0000","last_fullsized":"2024-04-13T02:44:41.287934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230427+0000","last_change":"2024-04-13T02:44:40.230572+0000","last_active":"2024-04-13T02:44:41.230427+0000","last_peered":"2024-04-13T02:44:41.230427+0000","last_clean":"2024-04-13T02:44:41.230427+0000","last_became_active":"2024-04-13T02:44:40.230294+0000","last_became_peered":"2024-04-13T02:44:40.230294+0000","last_unstale":"2024-04-13T02:44:41.230427+0000","last_undegraded":"2024-04-13T02:44:41.230427+0000","last_fullsized":"2024-04-13T02:44:41.230427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223241+0000","last_change":"2024-04-13T02:44:40.225831+0000","last_active":"2024-04-13T02:44:41.223241+0000","last_peered":"2024-04-13T02:44:41.223241+0000","last_clean":"2024-04-13T02:44:41.223241+0000","last_became_active":"2024-04-13T02:44:40.225519+0000","last_became_peered":"2024-04-13T02:44:40.225519+0000","last_unstale":"2024-04-13T02:44:41.223241+0000","last_undegraded":"2024-04-13T02:44:41.223241+0000","last_fullsized":"2024-04-13T02:44:41.223241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287503+0000","last_change":"2024-04-13T02:44:40.231590+0000","last_active":"2024-04-13T02:44:41.287503+0000","last_peered":"2024-04-13T02:44:41.287503+0000","last_clean":"2024-04-13T02:44:41.287503+0000","last_became_active":"2024-04-13T02:44:40.231334+0000","last_became_peered":"2024-04-13T02:44:40.231334+0000","last_unstale":"2024-04-13T02:44:41.287503+0000","last_undegraded":"2024-04-13T02:44:41.287503+0000","last_fullsized":"2024-04-13T02:44:41.287503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286995+0000","last_change":"2024-04-13T02:44:40.227342+0000","last_active":"2024-04-13T02:44:41.286995+0000","last_peered":"2024-04-13T02:44:41.286995+0000","last_clean":"2024-04-13T02:44:41.286995+0000","last_became_active":"2024-04-13T02:44:40.227062+0000","last_became_peered":"2024-04-13T02:44:40.227062+0000","last_unstale":"2024-04-13T02:44:41.286995+0000","last_undegraded":"2024-04-13T02:44:41.286995+0000","last_fullsized":"2024-04-13T02:44:41.286995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287004+0000","last_change":"2024-04-13T02:44:40.232709+0000","last_active":"2024-04-13T02:44:41.287004+0000","last_peered":"2024-04-13T02:44:41.287004+0000","last_clean":"2024-04-13T02:44:41.287004+0000","last_became_active":"2024-04-13T02:44:40.232444+0000","last_became_peered":"2024-04-13T02:44:40.232444+0000","last_unstale":"2024-04-13T02:44:41.287004+0000","last_undegraded":"2024-04-13T02:44:41.287004+0000","last_fullsized":"2024-04-13T02:44:41.287004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:05.949674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286710+0000","last_change":"2024-04-13T02:44:40.239126+0000","last_active":"2024-04-13T02:44:41.286710+0000","last_peered":"2024-04-13T02:44:41.286710+0000","last_clean":"2024-04-13T02:44:41.286710+0000","last_became_active":"2024-04-13T02:44:40.238820+0000","last_became_peered":"2024-04-13T02:44:40.238820+0000","last_unstale":"2024-04-13T02:44:41.286710+0000","last_undegraded":"2024-04-13T02:44:41.286710+0000","last_fullsized":"2024-04-13T02:44:41.286710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:24.204040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228646+0000","last_change":"2024-04-13T02:44:40.225771+0000","last_active":"2024-04-13T02:44:41.228646+0000","last_peered":"2024-04-13T02:44:41.228646+0000","last_clean":"2024-04-13T02:44:41.228646+0000","last_became_active":"2024-04-13T02:44:40.225482+0000","last_became_peered":"2024-04-13T02:44:40.225482+0000","last_unstale":"2024-04-13T02:44:41.228646+0000","last_undegraded":"2024-04-13T02:44:41.228646+0000","last_fullsized":"2024-04-13T02:44:41.228646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:43:21.359238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231043+0000","last_change":"2024-04-13T02:44:40.228987+0000","last_active":"2024-04-13T02:44:41.231043+0000","last_peered":"2024-04-13T02:44:41.231043+0000","last_clean":"2024-04-13T02:44:41.231043+0000","last_became_active":"2024-04-13T02:44:40.228645+0000","last_became_peered":"2024-04-13T02:44:40.228645+0000","last_unstale":"2024-04-13T02:44:41.231043+0000","last_undegraded":"2024-04-13T02:44:41.231043+0000","last_fullsized":"2024-04-13T02:44:41.231043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:53.107374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287771+0000","last_change":"2024-04-13T02:44:39.214920+0000","last_active":"2024-04-13T02:44:41.287771+0000","last_peered":"2024-04-13T02:44:41.287771+0000","last_clean":"2024-04-13T02:44:41.287771+0000","last_became_active":"2024-04-13T02:44:39.213481+0000","last_became_peered":"2024-04-13T02:44:39.213481+0000","last_unstale":"2024-04-13T02:44:41.287771+0000","last_undegraded":"2024-04-13T02:44:41.287771+0000","last_fullsized":"2024-04-13T02:44:41.287771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287017+0000","last_change":"2024-04-13T02:44:40.227426+0000","last_active":"2024-04-13T02:44:41.287017+0000","last_peered":"2024-04-13T02:44:41.287017+0000","last_clean":"2024-04-13T02:44:41.287017+0000","last_became_active":"2024-04-13T02:44:40.226865+0000","last_became_peered":"2024-04-13T02:44:40.226865+0000","last_unstale":"2024-04-13T02:44:41.287017+0000","last_undegraded":"2024-04-13T02:44:41.287017+0000","last_fullsized":"2024-04-13T02:44:41.287017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228853+0000","last_change":"2024-04-13T02:44:39.216952+0000","last_active":"2024-04-13T02:44:41.228853+0000","last_peered":"2024-04-13T02:44:41.228853+0000","last_clean":"2024-04-13T02:44:41.228853+0000","last_became_active":"2024-04-13T02:44:39.216642+0000","last_became_peered":"2024-04-13T02:44:39.216642+0000","last_unstale":"2024-04-13T02:44:41.228853+0000","last_undegraded":"2024-04-13T02:44:41.228853+0000","last_fullsized":"2024-04-13T02:44:41.228853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287286+0000","last_change":"2024-04-13T02:44:39.215674+0000","last_active":"2024-04-13T02:44:41.287286+0000","last_peered":"2024-04-13T02:44:41.287286+0000","last_clean":"2024-04-13T02:44:41.287286+0000","last_became_active":"2024-04-13T02:44:39.215390+0000","last_became_peered":"2024-04-13T02:44:39.215390+0000","last_unstale":"2024-04-13T02:44:41.287286+0000","last_undegraded":"2024-04-13T02:44:41.287286+0000","last_fullsized":"2024-04-13T02:44:41.287286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287324+0000","last_change":"2024-04-13T02:44:40.224744+0000","last_active":"2024-04-13T02:44:41.287324+0000","last_peered":"2024-04-13T02:44:41.287324+0000","last_clean":"2024-04-13T02:44:41.287324+0000","last_became_active":"2024-04-13T02:44:40.224408+0000","last_became_peered":"2024-04-13T02:44:40.224408+0000","last_unstale":"2024-04-13T02:44:41.287324+0000","last_undegraded":"2024-04-13T02:44:41.287324+0000","last_fullsized":"2024-04-13T02:44:41.287324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286792+0000","last_change":"2024-04-13T02:44:39.222541+0000","last_active":"2024-04-13T02:44:41.286792+0000","last_peered":"2024-04-13T02:44:41.286792+0000","last_clean":"2024-04-13T02:44:41.286792+0000","last_became_active":"2024-04-13T02:44:39.222178+0000","last_became_peered":"2024-04-13T02:44:39.222178+0000","last_unstale":"2024-04-13T02:44:41.286792+0000","last_undegraded":"2024-04-13T02:44:41.286792+0000","last_fullsized":"2024-04-13T02:44:41.286792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223143+0000","last_change":"2024-04-13T02:44:40.229697+0000","last_active":"2024-04-13T02:44:41.223143+0000","last_peered":"2024-04-13T02:44:41.223143+0000","last_clean":"2024-04-13T02:44:41.223143+0000","last_became_active":"2024-04-13T02:44:40.228188+0000","last_became_peered":"2024-04-13T02:44:40.228188+0000","last_unstale":"2024-04-13T02:44:41.223143+0000","last_undegraded":"2024-04-13T02:44:41.223143+0000","last_fullsized":"2024-04-13T02:44:41.223143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229958+0000","last_change":"2024-04-13T02:44:39.224508+0000","last_active":"2024-04-13T02:44:41.229958+0000","last_peered":"2024-04-13T02:44:41.229958+0000","last_clean":"2024-04-13T02:44:41.229958+0000","last_became_active":"2024-04-13T02:44:39.224118+0000","last_became_peered":"2024-04-13T02:44:39.224118+0000","last_unstale":"2024-04-13T02:44:41.229958+0000","last_undegraded":"2024-04-13T02:44:41.229958+0000","last_fullsized":"2024-04-13T02:44:41.229958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287025+0000","last_change":"2024-04-13T02:44:40.232833+0000","last_active":"2024-04-13T02:44:41.287025+0000","last_peered":"2024-04-13T02:44:41.287025+0000","last_clean":"2024-04-13T02:44:41.287025+0000","last_became_active":"2024-04-13T02:44:40.232554+0000","last_became_peered":"2024-04-13T02:44:40.232554+0000","last_unstale":"2024-04-13T02:44:41.287025+0000","last_undegraded":"2024-04-13T02:44:41.287025+0000","last_fullsized":"2024-04-13T02:44:41.287025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:52:45.259162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286911+0000","last_change":"2024-04-13T02:44:39.223166+0000","last_active":"2024-04-13T02:44:41.286911+0000","last_peered":"2024-04-13T02:44:41.286911+0000","last_clean":"2024-04-13T02:44:41.286911+0000","last_became_active":"2024-04-13T02:44:39.222884+0000","last_became_peered":"2024-04-13T02:44:39.222884+0000","last_unstale":"2024-04-13T02:44:41.286911+0000","last_undegraded":"2024-04-13T02:44:41.286911+0000","last_fullsized":"2024-04-13T02:44:41.286911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287061+0000","last_change":"2024-04-13T02:44:40.237654+0000","last_active":"2024-04-13T02:44:41.287061+0000","last_peered":"2024-04-13T02:44:41.287061+0000","last_clean":"2024-04-13T02:44:41.287061+0000","last_became_active":"2024-04-13T02:44:40.237119+0000","last_became_peered":"2024-04-13T02:44:40.237119+0000","last_unstale":"2024-04-13T02:44:41.287061+0000","last_undegraded":"2024-04-13T02:44:41.287061+0000","last_fullsized":"2024-04-13T02:44:41.287061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223435+0000","last_change":"2024-04-13T02:44:39.221993+0000","last_active":"2024-04-13T02:44:41.223435+0000","last_peered":"2024-04-13T02:44:41.223435+0000","last_clean":"2024-04-13T02:44:41.223435+0000","last_became_active":"2024-04-13T02:44:39.221682+0000","last_became_peered":"2024-04-13T02:44:39.221682+0000","last_unstale":"2024-04-13T02:44:41.223435+0000","last_undegraded":"2024-04-13T02:44:41.223435+0000","last_fullsized":"2024-04-13T02:44:41.223435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:29.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231233+0000","last_change":"2024-04-13T02:44:40.229580+0000","last_active":"2024-04-13T02:44:41.231233+0000","last_peered":"2024-04-13T02:44:41.231233+0000","last_clean":"2024-04-13T02:44:41.231233+0000","last_became_active":"2024-04-13T02:44:40.229234+0000","last_became_peered":"2024-04-13T02:44:40.229234+0000","last_unstale":"2024-04-13T02:44:41.231233+0000","last_undegraded":"2024-04-13T02:44:41.231233+0000","last_fullsized":"2024-04-13T02:44:41.231233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:24.204040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229184+0000","last_change":"2024-04-13T02:44:39.220422+0000","last_active":"2024-04-13T02:44:41.229184+0000","last_peered":"2024-04-13T02:44:41.229184+0000","last_clean":"2024-04-13T02:44:41.229184+0000","last_became_active":"2024-04-13T02:44:39.220071+0000","last_became_peered":"2024-04-13T02:44:39.220071+0000","last_unstale":"2024-04-13T02:44:41.229184+0000","last_undegraded":"2024-04-13T02:44:41.229184+0000","last_fullsized":"2024-04-13T02:44:41.229184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229245+0000","last_change":"2024-04-13T02:44:40.226890+0000","last_active":"2024-04-13T02:44:41.229245+0000","last_peered":"2024-04-13T02:44:41.229245+0000","last_clean":"2024-04-13T02:44:41.229245+0000","last_became_active":"2024-04-13T02:44:40.224137+0000","last_became_peered":"2024-04-13T02:44:40.224137+0000","last_unstale":"2024-04-13T02:44:41.229245+0000","last_undegraded":"2024-04-13T02:44:41.229245+0000","last_fullsized":"2024-04-13T02:44:41.229245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:50:34.978493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287114+0000","last_change":"2024-04-13T02:44:39.215405+0000","last_active":"2024-04-13T02:44:41.287114+0000","last_peered":"2024-04-13T02:44:41.287114+0000","last_clean":"2024-04-13T02:44:41.287114+0000","last_became_active":"2024-04-13T02:44:39.215134+0000","last_became_peered":"2024-04-13T02:44:39.215134+0000","last_unstale":"2024-04-13T02:44:41.287114+0000","last_undegraded":"2024-04-13T02:44:41.287114+0000","last_fullsized":"2024-04-13T02:44:41.287114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:01:39.290126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286601+0000","last_change":"2024-04-13T02:44:40.236884+0000","last_active":"2024-04-13T02:44:41.286601+0000","last_peered":"2024-04-13T02:44:41.286601+0000","last_clean":"2024-04-13T02:44:41.286601+0000","last_became_active":"2024-04-13T02:44:40.236622+0000","last_became_peered":"2024-04-13T02:44:40.236622+0000","last_unstale":"2024-04-13T02:44:41.286601+0000","last_undegraded":"2024-04-13T02:44:41.286601+0000","last_fullsized":"2024-04-13T02:44:41.286601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:12:12.862195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286931+0000","last_change":"2024-04-13T02:44:39.222283+0000","last_active":"2024-04-13T02:44:41.286931+0000","last_peered":"2024-04-13T02:44:41.286931+0000","last_clean":"2024-04-13T02:44:41.286931+0000","last_became_active":"2024-04-13T02:44:39.222011+0000","last_became_peered":"2024-04-13T02:44:39.222011+0000","last_unstale":"2024-04-13T02:44:41.286931+0000","last_undegraded":"2024-04-13T02:44:41.286931+0000","last_fullsized":"2024-04-13T02:44:41.286931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230336+0000","last_change":"2024-04-13T02:44:40.226836+0000","last_active":"2024-04-13T02:44:41.230336+0000","last_peered":"2024-04-13T02:44:41.230336+0000","last_clean":"2024-04-13T02:44:41.230336+0000","last_became_active":"2024-04-13T02:44:40.226543+0000","last_became_peered":"2024-04-13T02:44:40.226543+0000","last_unstale":"2024-04-13T02:44:41.230336+0000","last_undegraded":"2024-04-13T02:44:41.230336+0000","last_fullsized":"2024-04-13T02:44:41.230336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:02:38.309228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228786+0000","last_change":"2024-04-13T02:44:39.217101+0000","last_active":"2024-04-13T02:44:41.228786+0000","last_peered":"2024-04-13T02:44:41.228786+0000","last_clean":"2024-04-13T02:44:41.228786+0000","last_became_active":"2024-04-13T02:44:39.216631+0000","last_became_peered":"2024-04-13T02:44:39.216631+0000","last_unstale":"2024-04-13T02:44:41.228786+0000","last_undegraded":"2024-04-13T02:44:41.228786+0000","last_fullsized":"2024-04-13T02:44:41.228786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228647+0000","last_change":"2024-04-13T02:44:40.227724+0000","last_active":"2024-04-13T02:44:41.228647+0000","last_peered":"2024-04-13T02:44:41.228647+0000","last_clean":"2024-04-13T02:44:41.228647+0000","last_became_active":"2024-04-13T02:44:40.226329+0000","last_became_peered":"2024-04-13T02:44:40.226329+0000","last_unstale":"2024-04-13T02:44:41.228647+0000","last_undegraded":"2024-04-13T02:44:41.228647+0000","last_fullsized":"2024-04-13T02:44:41.228647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:24:13.168308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286319+0000","last_change":"2024-04-13T02:44:39.220470+0000","last_active":"2024-04-13T02:44:41.286319+0000","last_peered":"2024-04-13T02:44:41.286319+0000","last_clean":"2024-04-13T02:44:41.286319+0000","last_became_active":"2024-04-13T02:44:39.220165+0000","last_became_peered":"2024-04-13T02:44:39.220165+0000","last_unstale":"2024-04-13T02:44:41.286319+0000","last_undegraded":"2024-04-13T02:44:41.286319+0000","last_fullsized":"2024-04-13T02:44:41.286319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:23:20.613965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230076+0000","last_change":"2024-04-13T02:44:40.226549+0000","last_active":"2024-04-13T02:44:41.230076+0000","last_peered":"2024-04-13T02:44:41.230076+0000","last_clean":"2024-04-13T02:44:41.230076+0000","last_became_active":"2024-04-13T02:44:40.223509+0000","last_became_peered":"2024-04-13T02:44:40.223509+0000","last_unstale":"2024-04-13T02:44:41.230076+0000","last_undegraded":"2024-04-13T02:44:41.230076+0000","last_fullsized":"2024-04-13T02:44:41.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:09:46.354760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231188+0000","last_change":"2024-04-13T02:44:39.213369+0000","last_active":"2024-04-13T02:44:41.231188+0000","last_peered":"2024-04-13T02:44:41.231188+0000","last_clean":"2024-04-13T02:44:41.231188+0000","last_became_active":"2024-04-13T02:44:39.213049+0000","last_became_peered":"2024-04-13T02:44:39.213049+0000","last_unstale":"2024-04-13T02:44:41.231188+0000","last_undegraded":"2024-04-13T02:44:41.231188+0000","last_fullsized":"2024-04-13T02:44:41.231188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:29:00.582843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229693+0000","last_change":"2024-04-13T02:44:40.227249+0000","last_active":"2024-04-13T02:44:41.229693+0000","last_peered":"2024-04-13T02:44:41.229693+0000","last_clean":"2024-04-13T02:44:41.229693+0000","last_became_active":"2024-04-13T02:44:40.226935+0000","last_became_peered":"2024-04-13T02:44:40.226935+0000","last_unstale":"2024-04-13T02:44:41.229693+0000","last_undegraded":"2024-04-13T02:44:41.229693+0000","last_fullsized":"2024-04-13T02:44:41.229693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:38:37.826515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286339+0000","last_change":"2024-04-13T02:44:39.219683+0000","last_active":"2024-04-13T02:44:41.286339+0000","last_peered":"2024-04-13T02:44:41.286339+0000","last_clean":"2024-04-13T02:44:41.286339+0000","last_became_active":"2024-04-13T02:44:39.219383+0000","last_became_peered":"2024-04-13T02:44:39.219383+0000","last_unstale":"2024-04-13T02:44:41.286339+0000","last_undegraded":"2024-04-13T02:44:41.286339+0000","last_fullsized":"2024-04-13T02:44:41.286339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230678+0000","last_change":"2024-04-13T02:44:40.229158+0000","last_active":"2024-04-13T02:44:41.230678+0000","last_peered":"2024-04-13T02:44:41.230678+0000","last_clean":"2024-04-13T02:44:41.230678+0000","last_became_active":"2024-04-13T02:44:40.226959+0000","last_became_peered":"2024-04-13T02:44:40.226959+0000","last_unstale":"2024-04-13T02:44:41.230678+0000","last_undegraded":"2024-04-13T02:44:41.230678+0000","last_fullsized":"2024-04-13T02:44:41.230678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:42:12.349502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223394+0000","last_change":"2024-04-13T02:44:39.219002+0000","last_active":"2024-04-13T02:44:41.223394+0000","last_peered":"2024-04-13T02:44:41.223394+0000","last_clean":"2024-04-13T02:44:41.223394+0000","last_became_active":"2024-04-13T02:44:39.218708+0000","last_became_peered":"2024-04-13T02:44:39.218708+0000","last_unstale":"2024-04-13T02:44:41.223394+0000","last_undegraded":"2024-04-13T02:44:41.223394+0000","last_fullsized":"2024-04-13T02:44:41.223394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:23.200046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286950+0000","last_change":"2024-04-13T02:44:40.233452+0000","last_active":"2024-04-13T02:44:41.286950+0000","last_peered":"2024-04-13T02:44:41.286950+0000","last_clean":"2024-04-13T02:44:41.286950+0000","last_became_active":"2024-04-13T02:44:40.233136+0000","last_became_peered":"2024-04-13T02:44:40.233136+0000","last_unstale":"2024-04-13T02:44:41.286950+0000","last_undegraded":"2024-04-13T02:44:41.286950+0000","last_fullsized":"2024-04-13T02:44:41.286950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286687+0000","last_change":"2024-04-13T02:44:39.224219+0000","last_active":"2024-04-13T02:44:41.286687+0000","last_peered":"2024-04-13T02:44:41.286687+0000","last_clean":"2024-04-13T02:44:41.286687+0000","last_became_active":"2024-04-13T02:44:39.223880+0000","last_became_peered":"2024-04-13T02:44:39.223880+0000","last_unstale":"2024-04-13T02:44:41.286687+0000","last_undegraded":"2024-04-13T02:44:41.286687+0000","last_fullsized":"2024-04-13T02:44:41.286687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:37:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229315+0000","last_change":"2024-04-13T02:44:40.237388+0000","last_active":"2024-04-13T02:44:41.229315+0000","last_peered":"2024-04-13T02:44:41.229315+0000","last_clean":"2024-04-13T02:44:41.229315+0000","last_became_active":"2024-04-13T02:44:40.237135+0000","last_became_peered":"2024-04-13T02:44:40.237135+0000","last_unstale":"2024-04-13T02:44:41.229315+0000","last_undegraded":"2024-04-13T02:44:41.229315+0000","last_fullsized":"2024-04-13T02:44:41.229315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229819+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:44:41.229819+0000","last_peered":"2024-04-13T02:44:41.229819+0000","last_clean":"2024-04-13T02:44:41.229819+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:44:41.229819+0000","last_undegraded":"2024-04-13T02:44:41.229819+0000","last_fullsized":"2024-04-13T02:44:41.229819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286679+0000","last_change":"2024-04-13T02:44:39.223022+0000","last_active":"2024-04-13T02:44:41.286679+0000","last_peered":"2024-04-13T02:44:41.286679+0000","last_clean":"2024-04-13T02:44:41.286679+0000","last_became_active":"2024-04-13T02:44:39.222581+0000","last_became_peered":"2024-04-13T02:44:39.222581+0000","last_unstale":"2024-04-13T02:44:41.286679+0000","last_undegraded":"2024-04-13T02:44:41.286679+0000","last_fullsized":"2024-04-13T02:44:41.286679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287663+0000","last_change":"2024-04-13T02:44:40.237625+0000","last_active":"2024-04-13T02:44:41.287663+0000","last_peered":"2024-04-13T02:44:41.287663+0000","last_clean":"2024-04-13T02:44:41.287663+0000","last_became_active":"2024-04-13T02:44:40.237335+0000","last_became_peered":"2024-04-13T02:44:40.237335+0000","last_unstale":"2024-04-13T02:44:41.287663+0000","last_undegraded":"2024-04-13T02:44:41.287663+0000","last_fullsized":"2024-04-13T02:44:41.287663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229759+0000","last_change":"2024-04-13T02:44:39.223819+0000","last_active":"2024-04-13T02:44:41.229759+0000","last_peered":"2024-04-13T02:44:41.229759+0000","last_clean":"2024-04-13T02:44:41.229759+0000","last_became_active":"2024-04-13T02:44:39.223502+0000","last_became_peered":"2024-04-13T02:44:39.223502+0000","last_unstale":"2024-04-13T02:44:41.229759+0000","last_undegraded":"2024-04-13T02:44:41.229759+0000","last_fullsized":"2024-04-13T02:44:41.229759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:45:23.200046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286745+0000","last_change":"2024-04-13T02:44:40.227306+0000","last_active":"2024-04-13T02:44:41.286745+0000","last_peered":"2024-04-13T02:44:41.286745+0000","last_clean":"2024-04-13T02:44:41.286745+0000","last_became_active":"2024-04-13T02:44:40.227034+0000","last_became_peered":"2024-04-13T02:44:40.227034+0000","last_unstale":"2024-04-13T02:44:41.286745+0000","last_undegraded":"2024-04-13T02:44:41.286745+0000","last_fullsized":"2024-04-13T02:44:41.286745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:12:10.847444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286791+0000","last_change":"2024-04-13T02:44:39.221174+0000","last_active":"2024-04-13T02:44:41.286791+0000","last_peered":"2024-04-13T02:44:41.286791+0000","last_clean":"2024-04-13T02:44:41.286791+0000","last_became_active":"2024-04-13T02:44:39.220885+0000","last_became_peered":"2024-04-13T02:44:39.220885+0000","last_unstale":"2024-04-13T02:44:41.286791+0000","last_undegraded":"2024-04-13T02:44:41.286791+0000","last_fullsized":"2024-04-13T02:44:41.286791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223245+0000","last_change":"2024-04-13T02:44:40.222634+0000","last_active":"2024-04-13T02:44:41.223245+0000","last_peered":"2024-04-13T02:44:41.223245+0000","last_clean":"2024-04-13T02:44:41.223245+0000","last_became_active":"2024-04-13T02:44:40.222243+0000","last_became_peered":"2024-04-13T02:44:40.222243+0000","last_unstale":"2024-04-13T02:44:41.223245+0000","last_undegraded":"2024-04-13T02:44:41.223245+0000","last_fullsized":"2024-04-13T02:44:41.223245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:34:53.124794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287055+0000","last_change":"2024-04-13T02:44:39.223485+0000","last_active":"2024-04-13T02:44:41.287055+0000","last_peered":"2024-04-13T02:44:41.287055+0000","last_clean":"2024-04-13T02:44:41.287055+0000","last_became_active":"2024-04-13T02:44:39.223163+0000","last_became_peered":"2024-04-13T02:44:39.223163+0000","last_unstale":"2024-04-13T02:44:41.287055+0000","last_undegraded":"2024-04-13T02:44:41.287055+0000","last_fullsized":"2024-04-13T02:44:41.287055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:43.259767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.231172+0000","last_change":"2024-04-13T02:44:40.222929+0000","last_active":"2024-04-13T02:44:41.231172+0000","last_peered":"2024-04-13T02:44:41.231172+0000","last_clean":"2024-04-13T02:44:41.231172+0000","last_became_active":"2024-04-13T02:44:40.222596+0000","last_became_peered":"2024-04-13T02:44:40.222596+0000","last_unstale":"2024-04-13T02:44:41.231172+0000","last_undegraded":"2024-04-13T02:44:41.231172+0000","last_fullsized":"2024-04-13T02:44:41.231172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:44.263761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223367+0000","last_change":"2024-04-13T02:44:39.223044+0000","last_active":"2024-04-13T02:44:41.223367+0000","last_peered":"2024-04-13T02:44:41.223367+0000","last_clean":"2024-04-13T02:44:41.223367+0000","last_became_active":"2024-04-13T02:44:39.222291+0000","last_became_peered":"2024-04-13T02:44:39.222291+0000","last_unstale":"2024-04-13T02:44:41.223367+0000","last_undegraded":"2024-04-13T02:44:41.223367+0000","last_fullsized":"2024-04-13T02:44:41.223367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:19:52.103380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287274+0000","last_change":"2024-04-13T02:44:40.233688+0000","last_active":"2024-04-13T02:44:41.287274+0000","last_peered":"2024-04-13T02:44:41.287274+0000","last_clean":"2024-04-13T02:44:41.287274+0000","last_became_active":"2024-04-13T02:44:40.232532+0000","last_became_peered":"2024-04-13T02:44:40.232532+0000","last_unstale":"2024-04-13T02:44:41.287274+0000","last_undegraded":"2024-04-13T02:44:41.287274+0000","last_fullsized":"2024-04-13T02:44:41.287274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:09:46.354760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229734+0000","last_change":"2024-04-13T02:44:39.221704+0000","last_active":"2024-04-13T02:44:41.229734+0000","last_peered":"2024-04-13T02:44:41.229734+0000","last_clean":"2024-04-13T02:44:41.229734+0000","last_became_active":"2024-04-13T02:44:39.221381+0000","last_became_peered":"2024-04-13T02:44:39.221381+0000","last_unstale":"2024-04-13T02:44:41.229734+0000","last_undegraded":"2024-04-13T02:44:41.229734+0000","last_fullsized":"2024-04-13T02:44:41.229734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:12:11.858201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223232+0000","last_change":"2024-04-13T02:44:40.226440+0000","last_active":"2024-04-13T02:44:41.223232+0000","last_peered":"2024-04-13T02:44:41.223232+0000","last_clean":"2024-04-13T02:44:41.223232+0000","last_became_active":"2024-04-13T02:44:40.225635+0000","last_became_peered":"2024-04-13T02:44:40.225635+0000","last_unstale":"2024-04-13T02:44:41.223232+0000","last_undegraded":"2024-04-13T02:44:41.223232+0000","last_fullsized":"2024-04-13T02:44:41.223232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.227924+0000","last_change":"2024-04-13T02:44:39.222891+0000","last_active":"2024-04-13T02:44:41.227924+0000","last_peered":"2024-04-13T02:44:41.227924+0000","last_clean":"2024-04-13T02:44:41.227924+0000","last_became_active":"2024-04-13T02:44:39.222401+0000","last_became_peered":"2024-04-13T02:44:39.222401+0000","last_unstale":"2024-04-13T02:44:41.227924+0000","last_undegraded":"2024-04-13T02:44:41.227924+0000","last_fullsized":"2024-04-13T02:44:41.227924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.288052+0000","last_change":"2024-04-13T02:44:40.229666+0000","last_active":"2024-04-13T02:44:41.288052+0000","last_peered":"2024-04-13T02:44:41.288052+0000","last_clean":"2024-04-13T02:44:41.288052+0000","last_became_active":"2024-04-13T02:44:40.229394+0000","last_became_peered":"2024-04-13T02:44:40.229394+0000","last_unstale":"2024-04-13T02:44:41.288052+0000","last_undegraded":"2024-04-13T02:44:41.288052+0000","last_fullsized":"2024-04-13T02:44:41.288052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:56:46.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230066+0000","last_change":"2024-04-13T02:44:39.220188+0000","last_active":"2024-04-13T02:44:41.230066+0000","last_peered":"2024-04-13T02:44:41.230066+0000","last_clean":"2024-04-13T02:44:41.230066+0000","last_became_active":"2024-04-13T02:44:39.219872+0000","last_became_peered":"2024-04-13T02:44:39.219872+0000","last_unstale":"2024-04-13T02:44:41.230066+0000","last_undegraded":"2024-04-13T02:44:41.230066+0000","last_fullsized":"2024-04-13T02:44:41.230066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:56:33.818303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287012+0000","last_change":"2024-04-13T02:44:40.228870+0000","last_active":"2024-04-13T02:44:41.287012+0000","last_peered":"2024-04-13T02:44:41.287012+0000","last_clean":"2024-04-13T02:44:41.287012+0000","last_became_active":"2024-04-13T02:44:40.228525+0000","last_became_peered":"2024-04-13T02:44:40.228525+0000","last_unstale":"2024-04-13T02:44:41.287012+0000","last_undegraded":"2024-04-13T02:44:41.287012+0000","last_fullsized":"2024-04-13T02:44:41.287012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:20:59.905687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228895+0000","last_change":"2024-04-13T02:44:39.217842+0000","last_active":"2024-04-13T02:44:41.228895+0000","last_peered":"2024-04-13T02:44:41.228895+0000","last_clean":"2024-04-13T02:44:41.228895+0000","last_became_active":"2024-04-13T02:44:39.217486+0000","last_became_peered":"2024-04-13T02:44:39.217486+0000","last_unstale":"2024-04-13T02:44:41.228895+0000","last_undegraded":"2024-04-13T02:44:41.228895+0000","last_fullsized":"2024-04-13T02:44:41.228895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:19:29.230353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230940+0000","last_change":"2024-04-13T02:44:40.217868+0000","last_active":"2024-04-13T02:44:41.230940+0000","last_peered":"2024-04-13T02:44:41.230940+0000","last_clean":"2024-04-13T02:44:41.230940+0000","last_became_active":"2024-04-13T02:44:40.217588+0000","last_became_peered":"2024-04-13T02:44:40.217588+0000","last_unstale":"2024-04-13T02:44:41.230940+0000","last_undegraded":"2024-04-13T02:44:41.230940+0000","last_fullsized":"2024-04-13T02:44:41.230940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:01.746931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223252+0000","last_change":"2024-04-13T02:44:39.220393+0000","last_active":"2024-04-13T02:44:41.223252+0000","last_peered":"2024-04-13T02:44:41.223252+0000","last_clean":"2024-04-13T02:44:41.223252+0000","last_became_active":"2024-04-13T02:44:39.220122+0000","last_became_peered":"2024-04-13T02:44:39.220122+0000","last_unstale":"2024-04-13T02:44:41.223252+0000","last_undegraded":"2024-04-13T02:44:41.223252+0000","last_fullsized":"2024-04-13T02:44:41.223252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:49:43.259767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287456+0000","last_change":"2024-04-13T02:44:40.227423+0000","last_active":"2024-04-13T02:44:41.287456+0000","last_peered":"2024-04-13T02:44:41.287456+0000","last_clean":"2024-04-13T02:44:41.287456+0000","last_became_active":"2024-04-13T02:44:40.227151+0000","last_became_peered":"2024-04-13T02:44:40.227151+0000","last_unstale":"2024-04-13T02:44:41.287456+0000","last_undegraded":"2024-04-13T02:44:41.287456+0000","last_fullsized":"2024-04-13T02:44:41.287456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:40:29.134957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.223304+0000","last_change":"2024-04-13T02:44:39.222583+0000","last_active":"2024-04-13T02:44:41.223304+0000","last_peered":"2024-04-13T02:44:41.223304+0000","last_clean":"2024-04-13T02:44:41.223304+0000","last_became_active":"2024-04-13T02:44:39.222307+0000","last_became_peered":"2024-04-13T02:44:39.222307+0000","last_unstale":"2024-04-13T02:44:41.223304+0000","last_undegraded":"2024-04-13T02:44:41.223304+0000","last_fullsized":"2024-04-13T02:44:41.223304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:17:00.742937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287720+0000","last_change":"2024-04-13T02:44:40.223063+0000","last_active":"2024-04-13T02:44:41.287720+0000","last_peered":"2024-04-13T02:44:41.287720+0000","last_clean":"2024-04-13T02:44:41.287720+0000","last_became_active":"2024-04-13T02:44:40.222790+0000","last_became_peered":"2024-04-13T02:44:40.222790+0000","last_unstale":"2024-04-13T02:44:41.287720+0000","last_undegraded":"2024-04-13T02:44:41.287720+0000","last_fullsized":"2024-04-13T02:44:41.287720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:22:29.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.230357+0000","last_change":"2024-04-13T02:44:39.215575+0000","last_active":"2024-04-13T02:44:41.230357+0000","last_peered":"2024-04-13T02:44:41.230357+0000","last_clean":"2024-04-13T02:44:41.230357+0000","last_became_active":"2024-04-13T02:44:39.215199+0000","last_became_peered":"2024-04-13T02:44:39.215199+0000","last_unstale":"2024-04-13T02:44:41.230357+0000","last_undegraded":"2024-04-13T02:44:41.230357+0000","last_fullsized":"2024-04-13T02:44:41.230357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:17:32.443063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.228884+0000","last_change":"2024-04-13T02:44:40.226463+0000","last_active":"2024-04-13T02:44:41.228884+0000","last_peered":"2024-04-13T02:44:41.228884+0000","last_clean":"2024-04-13T02:44:41.228884+0000","last_became_active":"2024-04-13T02:44:40.226185+0000","last_became_peered":"2024-04-13T02:44:40.226185+0000","last_unstale":"2024-04-13T02:44:41.228884+0000","last_undegraded":"2024-04-13T02:44:41.228884+0000","last_fullsized":"2024-04-13T02:44:41.228884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:33.455452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287104+0000","last_change":"2024-04-13T02:44:40.238975+0000","last_active":"2024-04-13T02:44:41.287104+0000","last_peered":"2024-04-13T02:44:41.287104+0000","last_clean":"2024-04-13T02:44:41.287104+0000","last_became_active":"2024-04-13T02:44:40.238416+0000","last_became_peered":"2024-04-13T02:44:40.238416+0000","last_unstale":"2024-04-13T02:44:41.287104+0000","last_undegraded":"2024-04-13T02:44:41.287104+0000","last_fullsized":"2024-04-13T02:44:41.287104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:38:37.826515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229450+0000","last_change":"2024-04-13T02:44:39.224883+0000","last_active":"2024-04-13T02:44:41.229450+0000","last_peered":"2024-04-13T02:44:41.229450+0000","last_clean":"2024-04-13T02:44:41.229450+0000","last_became_active":"2024-04-13T02:44:39.224587+0000","last_became_peered":"2024-04-13T02:44:39.224587+0000","last_unstale":"2024-04-13T02:44:41.229450+0000","last_undegraded":"2024-04-13T02:44:41.229450+0000","last_fullsized":"2024-04-13T02:44:41.229450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:43:18.401558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.286778+0000","last_change":"2024-04-13T02:44:40.239119+0000","last_active":"2024-04-13T02:44:41.286778+0000","last_peered":"2024-04-13T02:44:41.286778+0000","last_clean":"2024-04-13T02:44:41.286778+0000","last_became_active":"2024-04-13T02:44:40.238841+0000","last_became_peered":"2024-04-13T02:44:40.238841+0000","last_unstale":"2024-04-13T02:44:41.286778+0000","last_undegraded":"2024-04-13T02:44:41.286778+0000","last_fullsized":"2024-04-13T02:44:41.286778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:17:29.068269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.229347+0000","last_change":"2024-04-13T02:44:39.219315+0000","last_active":"2024-04-13T02:44:41.229347+0000","last_peered":"2024-04-13T02:44:41.229347+0000","last_clean":"2024-04-13T02:44:41.229347+0000","last_became_active":"2024-04-13T02:44:39.218997+0000","last_became_peered":"2024-04-13T02:44:39.218997+0000","last_unstale":"2024-04-13T02:44:41.229347+0000","last_undegraded":"2024-04-13T02:44:41.229347+0000","last_fullsized":"2024-04-13T02:44:41.229347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:08:03.429097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287022+0000","last_change":"2024-04-13T02:44:40.237798+0000","last_active":"2024-04-13T02:44:41.287022+0000","last_peered":"2024-04-13T02:44:41.287022+0000","last_clean":"2024-04-13T02:44:41.287022+0000","last_became_active":"2024-04-13T02:44:40.237420+0000","last_became_peered":"2024-04-13T02:44:40.237420+0000","last_unstale":"2024-04-13T02:44:41.287022+0000","last_undegraded":"2024-04-13T02:44:41.287022+0000","last_fullsized":"2024-04-13T02:44:41.287022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:44:31.852489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287851+0000","last_change":"2024-04-13T02:44:39.216773+0000","last_active":"2024-04-13T02:44:41.287851+0000","last_peered":"2024-04-13T02:44:41.287851+0000","last_clean":"2024-04-13T02:44:41.287851+0000","last_became_active":"2024-04-13T02:44:39.216483+0000","last_became_peered":"2024-04-13T02:44:39.216483+0000","last_unstale":"2024-04-13T02:44:41.287851+0000","last_undegraded":"2024-04-13T02:44:41.287851+0000","last_fullsized":"2024-04-13T02:44:41.287851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:36:17.093697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287891+0000","last_change":"2024-04-13T02:44:40.225518+0000","last_active":"2024-04-13T02:44:41.287891+0000","last_peered":"2024-04-13T02:44:41.287891+0000","last_clean":"2024-04-13T02:44:41.287891+0000","last_became_active":"2024-04-13T02:44:40.225251+0000","last_became_peered":"2024-04-13T02:44:40.225251+0000","last_unstale":"2024-04-13T02:44:41.287891+0000","last_undegraded":"2024-04-13T02:44:41.287891+0000","last_fullsized":"2024-04-13T02:44:41.287891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:39.198501+0000","last_clean_scrub_stamp":"2024-04-13T02:44:39.198501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:28:51.378035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-13T02:44:41.287116+0000","last_change":"2024-04-13T02:44:39.224484+0000","last_active":"2024-04-13T02:44:41.287116+0000","last_peered":"2024-04-13T02:44:41.287116+0000","last_clean":"2024-04-13T02:44:41.287116+0000","last_became_active":"2024-04-13T02:44:39.224147+0000","last_became_peered":"2024-04-13T02:44:39.224147+0000","last_unstale":"2024-04-13T02:44:41.287116+0000","last_undegraded":"2024-04-13T02:44:41.287116+0000","last_fullsized":"2024-04-13T02:44:41.287116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:38.194507+0000","last_clean_scrub_stamp":"2024-04-13T02:44:38.194507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:36:17.093697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:44:47.886 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-13T02:44:47.886 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-13T02:44:47.886 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-13T02:44:47.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-13T02:44:48.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.020+0000 7f1f4b236640 1 Processor -- start 2024-04-13T02:44:48.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.020+0000 7f1f4b236640 1 -- start start 2024-04-13T02:44:48.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f4b236640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b03f0 0x7f1f441625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f4b236640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f440b4bd0 0x7f1f440b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f4b236640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f44162c30 con 0x7f1f440b5a20 2024-04-13T02:44:48.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f4b236640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1f441634d0 con 0x7f1f440b4bd0 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f4b236640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f44162f10 con 0x7f1f440b03f0 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f43fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f440b4bd0 0x7f1f440b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f48fd2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b03f0 0x7f1f441625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f497d3640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1f440b5a20 0x7f1f4415f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:47754/0 (socket says 172.21.15.114:47754) 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.021+0000 7f1f497d3640 1 -- 172.21.15.114:0/3508078333 learned_addr learned my addr 172.21.15.114:0/3508078333 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f48fd2640 1 -- 172.21.15.114:0/3508078333 >> v2:172.21.15.130:3300/0 conn(0x7f1f440b4bd0 msgr2=0x7f1f440b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f48fd2640 1 --2- 172.21.15.114:0/3508078333 >> v2:172.21.15.130:3300/0 conn(0x7f1f440b4bd0 0x7f1f440b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f48fd2640 1 -- 172.21.15.114:0/3508078333 >> v1:172.21.15.130:6789/0 conn(0x7f1f440b5a20 legacy=0x7f1f4415f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f48fd2640 1 -- 172.21.15.114:0/3508078333 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f441631f0 con 0x7f1f440b03f0 2024-04-13T02:44:48.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f43fff640 1 --2- 172.21.15.114:0/3508078333 >> v2:172.21.15.130:3300/0 conn(0x7f1f440b4bd0 0x7f1f440b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f48fd2640 1 --2- 172.21.15.114:0/3508078333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b03f0 0x7f1f441625a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0097a0 tx=0x7f1f2c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0af495f053a3902 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f437fe640 1 -- 172.21.15.114:0/3508078333 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c038070 con 0x7f1f440b03f0 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f437fe640 1 -- 172.21.15.114:0/3508078333 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c031700 con 0x7f1f440b03f0 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.022+0000 7f1f437fe640 1 -- 172.21.15.114:0/3508078333 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c031ad0 con 0x7f1f440b03f0 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 -- 172.21.15.114:0/3508078333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b03f0 msgr2=0x7f1f441625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3508078333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b03f0 0x7f1f441625a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0097a0 tx=0x7f1f2c02b7a0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 -- 172.21.15.114:0/3508078333 shutdown_connections 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3508078333 >> v2:172.21.15.130:3300/0 conn(0x7f1f440b4bd0 0x7f1f440b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3508078333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b03f0 0x7f1f441625a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 -- 172.21.15.114:0/3508078333 >> 172.21.15.114:0/3508078333 conn(0x7f1f4406f8d0 msgr2=0x7f1f44072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 -- 172.21.15.114:0/3508078333 shutdown_connections 2024-04-13T02:44:48.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.023+0000 7f1f4b236640 1 -- 172.21.15.114:0/3508078333 wait complete. 2024-04-13T02:44:48.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.024+0000 7f1f4b236640 1 Processor -- start 2024-04-13T02:44:48.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.024+0000 7f1f4b236640 1 -- start start 2024-04-13T02:44:48.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f4b236640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b03f0 0x7f1f441568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f4b236640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b4bd0 0x7f1f4415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f4b236640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 0x7f1f4415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f4b236640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4415ff00 con 0x7f1f440b5a20 2024-04-13T02:44:48.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f4b236640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4415fd80 con 0x7f1f440b03f0 2024-04-13T02:44:48.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f4b236640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f44073180 con 0x7f1f440b4bd0 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 0x7f1f4415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 0x7f1f4415b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53192/0 (socket says 172.21.15.114:53192) 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 -- 172.21.15.114:0/3774847259 learned_addr learned my addr 172.21.15.114:0/3774847259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f48fd2640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b03f0 0x7f1f441568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f43fff640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b4bd0 0x7f1f4415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 -- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b4bd0 msgr2=0x7f1f4415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b4bd0 0x7f1f4415af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 -- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b03f0 msgr2=0x7f1f441568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b03f0 0x7f1f441568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f497d3640 1 -- 172.21.15.114:0/3774847259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4415bae0 con 0x7f1f440b5a20 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.025+0000 7f1f48fd2640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b03f0 0x7f1f441568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.026+0000 7f1f497d3640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 0x7f1f4415b4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c370 tx=0x7f1f3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.026+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c017070 con 0x7f1f440b5a20 2024-04-13T02:44:48.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.026+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c005ce0 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.026+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f441602d0 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.026+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0072d0 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.026+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f44160890 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.027+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f44068c80 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.027+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f3c01a070 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.028+0000 7f1f417fa640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f2406c8f0 0x7f1f2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.028+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f3c08ad40 con 0x7f1f440b5a20 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.028+0000 7f1f48fd2640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f2406c8f0 0x7f1f2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.028+0000 7f1f48fd2640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f2406c8f0 0x7f1f2406edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c035000 tx=0x7f1f2c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.032+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f3c058b30 con 0x7f1f440b5a20 2024-04-13T02:44:48.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.248+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f440680d0 con 0x7f1f440b5a20 2024-04-13T02:44:48.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.248+0000 7f1f417fa640 1 -- 172.21.15.114:0/3774847259 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1f3c05ce30 con 0x7f1f440b5a20 2024-04-13T02:44:48.249 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:48.249 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-13T02:44:48.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f2406c8f0 msgr2=0x7f1f2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f2406c8f0 0x7f1f2406edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c035000 tx=0x7f1f2c008030 comp rx=0 tx=0).stop 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 msgr2=0x7f1f4415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 0x7f1f4415b4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c370 tx=0x7f1f3c00c830 comp rx=0 tx=0).stop 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 shutdown_connections 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f440b5a20 0x7f1f4415b4b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1f2406c8f0 0x7f1f2406edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f440b4bd0 0x7f1f4415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 --2- 172.21.15.114:0/3774847259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f440b03f0 0x7f1f441568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 >> 172.21.15.114:0/3774847259 conn(0x7f1f4406f8d0 msgr2=0x7f1f44072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 shutdown_connections 2024-04-13T02:44:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.250+0000 7f1f4b236640 1 -- 172.21.15.114:0/3774847259 wait complete. 2024-04-13T02:44:48.262 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-13T02:44:48.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.361+0000 7f75a571e640 1 Processor -- start 2024-04-13T02:44:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.361+0000 7f75a571e640 1 -- start start 2024-04-13T02:44:48.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f75a571e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f75a009b1e0 0x7f75a009b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f75a571e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a00c95e0 con 0x7f75a00cedf0 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f75a571e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a00d0320 con 0x7f75a009ae00 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f75a571e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f75a0160520 con 0x7f75a009b1e0 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f759e7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f75a00cedf0 0x7f75a00cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59002/0 (socket says 172.21.15.114:59002) 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f759e7fc640 1 -- 172.21.15.114:0/3263222490 learned_addr learned my addr 172.21.15.114:0/3263222490 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146699988 0 0) 0x7f75a00c95e0 con 0x7f75a00cedf0 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.362+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7588003520 con 0x7f75a00cedf0 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759f7fe640 1 --2- 172.21.15.114:0/3263222490 >> v2:172.21.15.130:3300/0 conn(0x7f75a009b1e0 0x7f75a009b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103074303 0 0) 0x7f7588003520 con 0x7f75a00cedf0 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 >> v2:172.21.15.130:3300/0 conn(0x7f75a009b1e0 msgr2=0x7f75a009b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 --2- 172.21.15.114:0/3263222490 >> v2:172.21.15.130:3300/0 conn(0x7f75a009b1e0 0x7f75a009b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 >> v1:172.21.15.130:6789/0 conn(0x7f75a009ae00 legacy=0x7f75a00cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a00d05e0 con 0x7f75a00cedf0 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f7594001670 con 0x7f75a00cedf0 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 >> v1:172.21.15.114:6789/0 conn(0x7f75a00cedf0 legacy=0x7f75a00cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75880039b0 0x7f7588003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7588004800 0x7f7588004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880051c0 0x7f758800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75a0160520 con 0x7f75880039b0 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f758800c160 con 0x7f7588004800 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f758800c360 con 0x7f75880051c0 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759effd640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75880039b0 0x7f7588003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759e7fc640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7588004800 0x7f7588004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759f7fe640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880051c0 0x7f758800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759effd640 1 -- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880051c0 msgr2=0x7f758800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759effd640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880051c0 0x7f758800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759effd640 1 -- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7588004800 msgr2=0x7f7588004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759effd640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7588004800 0x7f7588004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759effd640 1 -- 172.21.15.114:0/3263222490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7588003520 con 0x7f75880039b0 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.363+0000 7f759f7fe640 1 -- 172.21.15.114:0/3263222490 reap_dead start 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.364+0000 7f759effd640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75880039b0 0x7f7588003dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7590001e50 tx=0x7f7588005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e38e153d7e8451 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.364+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590001a70 con 0x7f75880039b0 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.364+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7590003b70 con 0x7f75880039b0 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.364+0000 7f759dffb640 1 -- 172.21.15.114:0/3263222490 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900050d0 con 0x7f75880039b0 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 -- 172.21.15.114:0/3263222490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75880039b0 msgr2=0x7f7588003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75880039b0 0x7f7588003dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7590001e50 tx=0x7f7588005830 comp rx=0 tx=0).stop 2024-04-13T02:44:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 -- 172.21.15.114:0/3263222490 shutdown_connections 2024-04-13T02:44:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 --2- 172.21.15.114:0/3263222490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75880039b0 0x7f7588003dd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 -- 172.21.15.114:0/3263222490 >> 172.21.15.114:0/3263222490 conn(0x7f75a00d2750 msgr2=0x7f75a00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 -- 172.21.15.114:0/3263222490 shutdown_connections 2024-04-13T02:44:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.365+0000 7f75a571e640 1 -- 172.21.15.114:0/3263222490 wait complete. 2024-04-13T02:44:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.366+0000 7f75a571e640 1 Processor -- start 2024-04-13T02:44:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.366+0000 7f75a571e640 1 -- start start 2024-04-13T02:44:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880039b0 0x7f75a00b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75a01f29a0 0x7f75a014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 0x7f75a00c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75a009b970 con 0x7f75a014fe90 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75a0160770 con 0x7f75a01f29a0 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f75a009baf0 con 0x7f75880039b0 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 0x7f75a00c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 0x7f75a00c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53200/0 (socket says 172.21.15.114:53200) 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 -- 172.21.15.114:0/3615745342 learned_addr learned my addr 172.21.15.114:0/3615745342 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759effd640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880039b0 0x7f75a00b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759e7fc640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75a01f29a0 0x7f75a014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 -- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880039b0 msgr2=0x7f75a00b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880039b0 0x7f75a00b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 -- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75a01f29a0 msgr2=0x7f75a014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75a01f29a0 0x7f75a014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 -- 172.21.15.114:0/3615745342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a00cc380 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f759f7fe640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 0x7f75a00c7840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75a0074040 tx=0x7f7598011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598004240 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759801b070 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a00cc660 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759800f740 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.367+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a01f2e00 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.368+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a0068c80 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.369+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7598012040 con 0x7f75a014fe90 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.369+0000 7f75877fe640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f758c06c8f0 0x7f758c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.369+0000 7f759effd640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f758c06c8f0 0x7f758c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.369+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f759808b7c0 con 0x7f75a014fe90 2024-04-13T02:44:48.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.369+0000 7f759effd640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f758c06c8f0 0x7f758c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7590034000 tx=0x7f759003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.373+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75980595a0 con 0x7f75a014fe90 2024-04-13T02:44:48.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.549+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75a00ccb60 con 0x7f75a014fe90 2024-04-13T02:44:48.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.550+0000 7f75877fe640 1 -- 172.21.15.114:0/3615745342 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f759805d8a0 con 0x7f75a014fe90 2024-04-13T02:44:48.551 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:48.551 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f758c06c8f0 msgr2=0x7f758c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f758c06c8f0 0x7f758c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7590034000 tx=0x7f759003b040 comp rx=0 tx=0).stop 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 msgr2=0x7f75a00c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 0x7f75a00c7840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75a0074040 tx=0x7f7598011cf0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 shutdown_connections 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75a014fe90 0x7f75a00c7840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75a01f29a0 0x7f75a014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f758c06c8f0 0x7f758c06edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 --2- 172.21.15.114:0/3615745342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75880039b0 0x7f75a00b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 >> 172.21.15.114:0/3615745342 conn(0x7f75a00d2750 msgr2=0x7f75a0071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 shutdown_connections 2024-04-13T02:44:48.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.552+0000 7f75a571e640 1 -- 172.21.15.114:0/3615745342 wait complete. 2024-04-13T02:44:48.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:44:48.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:44:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.666+0000 7fdbbeb88640 1 Processor -- start 2024-04-13T02:44:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.666+0000 7fdbbeb88640 1 -- start start 2024-04-13T02:44:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbeb88640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdbb809b230 0x7fdbb80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbeb88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbb806e2f0 0x7fdbb80d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbeb88640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb8071330 con 0x7fdbb80ce650 2024-04-13T02:44:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbeb88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb809bb40 con 0x7fdbb806e2f0 2024-04-13T02:44:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbeb88640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb806ce50 con 0x7fdbb809b230 2024-04-13T02:44:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbd125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbb806e2f0 0x7fdbb80d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbd125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbb806e2f0 0x7fdbb80d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35838/0 (socket says 172.21.15.114:35838) 2024-04-13T02:44:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.667+0000 7fdbbd125640 1 -- 172.21.15.114:0/428271602 learned_addr learned my addr 172.21.15.114:0/428271602 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbbd125640 1 -- 172.21.15.114:0/428271602 >> v2:172.21.15.130:3300/0 conn(0x7fdbb809b230 msgr2=0x7fdbb80d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbb7fff640 1 --2- 172.21.15.114:0/428271602 >> v2:172.21.15.130:3300/0 conn(0x7fdbb809b230 0x7fdbb80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbbd125640 1 --2- 172.21.15.114:0/428271602 >> v2:172.21.15.130:3300/0 conn(0x7fdbb809b230 0x7fdbb80d07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbbd125640 1 -- 172.21.15.114:0/428271602 >> v1:172.21.15.130:6789/0 conn(0x7fdbb80ce650 legacy=0x7fdbb809ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbbd125640 1 -- 172.21.15.114:0/428271602 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb806cae0 con 0x7fdbb806e2f0 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbbd125640 1 --2- 172.21.15.114:0/428271602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb806e2f0 0x7fdbb80d0cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8073710 tx=0x7fdbb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e027bf19224ac04a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbb77fe640 1 -- 172.21.15.114:0/428271602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0035020 con 0x7fdbb806e2f0 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.668+0000 7fdbb77fe640 1 -- 172.21.15.114:0/428271602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb0031870 con 0x7fdbb806e2f0 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbb77fe640 1 -- 172.21.15.114:0/428271602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0031c40 con 0x7fdbb806e2f0 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 -- 172.21.15.114:0/428271602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb806e2f0 msgr2=0x7fdbb80d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/428271602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb806e2f0 0x7fdbb80d0cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8073710 tx=0x7fdbb002b910 comp rx=0 tx=0).stop 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 -- 172.21.15.114:0/428271602 shutdown_connections 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/428271602 >> v2:172.21.15.130:3300/0 conn(0x7fdbb809b230 0x7fdbb80d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/428271602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb806e2f0 0x7fdbb80d0cf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 -- 172.21.15.114:0/428271602 >> 172.21.15.114:0/428271602 conn(0x7fdbb80d2720 msgr2=0x7fdbb80d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 -- 172.21.15.114:0/428271602 shutdown_connections 2024-04-13T02:44:48.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.669+0000 7fdbbeb88640 1 -- 172.21.15.114:0/428271602 wait complete. 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.670+0000 7fdbbeb88640 1 Processor -- start 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.670+0000 7fdbbeb88640 1 -- start start 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbeb88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb806e2f0 0x7fdbb80b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbeb88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 0x7fdbb80b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbeb88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb80ce650 0x7fdbb81549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbeb88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb809bd90 con 0x7fdbb809b230 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbeb88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb8071610 con 0x7fdbb80ce650 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbeb88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb80cea30 con 0x7fdbb806e2f0 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 0x7fdbb80b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 0x7fdbb80b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35852/0 (socket says 172.21.15.114:35852) 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 -- 172.21.15.114:0/2133146734 learned_addr learned my addr 172.21.15.114:0/2133146734 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbc924640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb806e2f0 0x7fdbb80b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 -- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb806e2f0 msgr2=0x7fdbb80b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbbd125640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb80ce650 0x7fdbb81549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb806e2f0 0x7fdbb80b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 -- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb80ce650 msgr2=0x7fdbb81549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb80ce650 0x7fdbb81549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.671+0000 7fdbb7fff640 1 -- 172.21.15.114:0/2133146734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb80b5d60 con 0x7fdbb809b230 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.672+0000 7fdbb7fff640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 0x7fdbb80b5380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00c7f0 tx=0x7fdbac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.672+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac015070 con 0x7fdbb809b230 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.672+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbac004240 con 0x7fdbb809b230 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.672+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb80b6040 con 0x7fdbb809b230 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.672+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac007620 con 0x7fdbb809b230 2024-04-13T02:44:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.672+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb80b6eb0 con 0x7fdbb809b230 2024-04-13T02:44:48.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.673+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb80b4010 con 0x7fdbb809b230 2024-04-13T02:44:48.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.673+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbac0079d0 con 0x7fdbb809b230 2024-04-13T02:44:48.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.674+0000 7fdbb57fa640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdba406c920 0x7fdba406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.674+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdbac08bb30 con 0x7fdbb809b230 2024-04-13T02:44:48.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.674+0000 7fdbbc924640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdba406c920 0x7fdba406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.674+0000 7fdbbc924640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdba406c920 0x7fdba406ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdba8007bf0 tx=0x7fdba8007240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.678+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdbb80b4010 con 0x7fdbb809b230 2024-04-13T02:44:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.852+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdbb8068c80 con 0x7fdbb809b230 2024-04-13T02:44:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.853+0000 7fdbb57fa640 1 -- 172.21.15.114:0/2133146734 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fdbac059ff0 con 0x7fdbb809b230 2024-04-13T02:44:48.854 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdba406c920 msgr2=0x7fdba406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdba406c920 0x7fdba406ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdba8007bf0 tx=0x7fdba8007240 comp rx=0 tx=0).stop 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 msgr2=0x7fdbb80b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 0x7fdbb80b5380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00c7f0 tx=0x7fdbac00ccb0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 shutdown_connections 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb80ce650 0x7fdbb81549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb809b230 0x7fdbb80b5380 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdba406c920 0x7fdba406ede0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 --2- 172.21.15.114:0/2133146734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb806e2f0 0x7fdbb80b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 >> 172.21.15.114:0/2133146734 conn(0x7fdbb80d2720 msgr2=0x7fdbb80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 shutdown_connections 2024-04-13T02:44:48.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.855+0000 7fdbbeb88640 1 -- 172.21.15.114:0/2133146734 wait complete. 2024-04-13T02:44:48.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:44:48.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.968+0000 7f55db036640 1 Processor -- start 2024-04-13T02:44:48.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.968+0000 7f55db036640 1 -- start start 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55db036640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55d415cb10 0x7f55d409bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55db036640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55d40b15c0 0x7f55d409ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55db036640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d409b0d0 0x7f55d41605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55db036640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f55d40b6e50 con 0x7f55d415cb10 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55db036640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f55d409c2a0 con 0x7f55d40b15c0 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55db036640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f55d40afd50 con 0x7f55d409b0d0 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55d8dd2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55d415cb10 0x7f55d409bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55d8dd2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55d415cb10 0x7f55d409bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35854/0 (socket says 172.21.15.114:35854) 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.969+0000 7f55d8dd2640 1 -- 172.21.15.114:0/4060298140 learned_addr learned my addr 172.21.15.114:0/4060298140 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d3fff640 1 --2- 172.21.15.114:0/4060298140 >> v2:172.21.15.130:3300/0 conn(0x7f55d40b15c0 0x7f55d409ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d8dd2640 1 -- 172.21.15.114:0/4060298140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d409b0d0 msgr2=0x7f55d41605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d95d3640 1 --2- 172.21.15.114:0/4060298140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d409b0d0 0x7f55d41605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d8dd2640 1 --2- 172.21.15.114:0/4060298140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d409b0d0 0x7f55d41605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d8dd2640 1 -- 172.21.15.114:0/4060298140 >> v2:172.21.15.130:3300/0 conn(0x7f55d40b15c0 msgr2=0x7f55d409ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d8dd2640 1 --2- 172.21.15.114:0/4060298140 >> v2:172.21.15.130:3300/0 conn(0x7f55d40b15c0 0x7f55d409ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d8dd2640 1 -- 172.21.15.114:0/4060298140 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d40b62d0 con 0x7f55d415cb10 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d8dd2640 1 --2- 172.21.15.114:0/4060298140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d409bd60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55d4073080 tx=0x7f55c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5444e0431aac7967 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.970+0000 7f55d37fe640 1 -- 172.21.15.114:0/4060298140 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c402e070 con 0x7f55d415cb10 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55d37fe640 1 -- 172.21.15.114:0/4060298140 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c4037070 con 0x7f55d415cb10 2024-04-13T02:44:48.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55d37fe640 1 -- 172.21.15.114:0/4060298140 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4031a00 con 0x7f55d415cb10 2024-04-13T02:44:48.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 -- 172.21.15.114:0/4060298140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 msgr2=0x7f55d409bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 --2- 172.21.15.114:0/4060298140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d409bd60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55d4073080 tx=0x7f55c402b880 comp rx=0 tx=0).stop 2024-04-13T02:44:48.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 -- 172.21.15.114:0/4060298140 shutdown_connections 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 --2- 172.21.15.114:0/4060298140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d409b0d0 0x7f55d41605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 --2- 172.21.15.114:0/4060298140 >> v2:172.21.15.130:3300/0 conn(0x7f55d40b15c0 0x7f55d409ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 --2- 172.21.15.114:0/4060298140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d409bd60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 -- 172.21.15.114:0/4060298140 >> 172.21.15.114:0/4060298140 conn(0x7f55d40b4390 msgr2=0x7f55d40b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 -- 172.21.15.114:0/4060298140 shutdown_connections 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.971+0000 7f55db036640 1 -- 172.21.15.114:0/4060298140 wait complete. 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.972+0000 7f55db036640 1 Processor -- start 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.972+0000 7f55db036640 1 -- start start 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55db036640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55d409b0d0 0x7f55d415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55db036640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d40b15c0 0x7f55d40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55db036640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55db036640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f55d40b6b70 con 0x7f55d415cb10 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55db036640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55d40b6890 con 0x7f55d409b0d0 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55db036640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f55d40b2060 con 0x7f55d40b15c0 2024-04-13T02:44:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55d95d3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55d95d3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d414c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35868/0 (socket says 172.21.15.114:35868) 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55d95d3640 1 -- 172.21.15.114:0/2706200570 learned_addr learned my addr 172.21.15.114:0/2706200570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.973+0000 7f55d8dd2640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55d409b0d0 0x7f55d415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d3fff640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d40b15c0 0x7f55d40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d95d3640 1 -- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d40b15c0 msgr2=0x7f55d40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d95d3640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d40b15c0 0x7f55d40cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d95d3640 1 -- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55d409b0d0 msgr2=0x7f55d415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d95d3640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55d409b0d0 0x7f55d415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d95d3640 1 -- 172.21.15.114:0/2706200570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d415bfd0 con 0x7f55d415cb10 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d3fff640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d40b15c0 0x7f55d40cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d95d3640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d414c100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00cb80 tx=0x7f55cc00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc015070 con 0x7f55d415cb10 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc00abd0 con 0x7f55d415cb10 2024-04-13T02:44:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d415a9f0 con 0x7f55d415cb10 2024-04-13T02:44:48.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00d040 con 0x7f55d415cb10 2024-04-13T02:44:48.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.974+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d415b290 con 0x7f55d415cb10 2024-04-13T02:44:48.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.975+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d4068c80 con 0x7f55d415cb10 2024-04-13T02:44:48.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.975+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55cc018070 con 0x7f55d415cb10 2024-04-13T02:44:48.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.976+0000 7f55d17fa640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f55c006c8f0 0x7f55c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.976+0000 7f55d8dd2640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f55c006c8f0 0x7f55c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.976+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55cc08b720 con 0x7f55d415cb10 2024-04-13T02:44:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.976+0000 7f55d8dd2640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f55c006c8f0 0x7f55c006edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55c4036000 tx=0x7f55c403d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:48.980+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f55cc059be0 con 0x7f55d415cb10 2024-04-13T02:44:49.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.154+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f55d409b830 con 0x7f55d415cb10 2024-04-13T02:44:49.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.155+0000 7f55d17fa640 1 -- 172.21.15.114:0/2706200570 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f55cc0594e0 con 0x7f55d415cb10 2024-04-13T02:44:49.155 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f55c006c8f0 msgr2=0x7f55c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f55c006c8f0 0x7f55c006edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55c4036000 tx=0x7f55c403d040 comp rx=0 tx=0).stop 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 msgr2=0x7f55d414c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d414c100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00cb80 tx=0x7f55cc00a4c0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 shutdown_connections 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d415cb10 0x7f55d414c100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f55c006c8f0 0x7f55c006edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55d40b15c0 0x7f55d40cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 --2- 172.21.15.114:0/2706200570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55d409b0d0 0x7f55d415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 >> 172.21.15.114:0/2706200570 conn(0x7f55d40b4390 msgr2=0x7f55d40b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:49.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 shutdown_connections 2024-04-13T02:44:49.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.157+0000 7f55db036640 1 -- 172.21.15.114:0/2706200570 wait complete. 2024-04-13T02:44:49.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:44:49.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.273+0000 7ffa4a71e640 1 Processor -- start 2024-04-13T02:44:49.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.273+0000 7ffa4a71e640 1 -- start start 2024-04-13T02:44:49.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa4a71e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa441591c0 0x7ffa4415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa4a71e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa4409ace0 0x7ffa440b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa4a71e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4415ffe0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa4a71e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ffa441595a0 con 0x7ffa441591c0 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa4a71e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffa44160220 con 0x7ffa4409ace0 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa441591c0 0x7ffa4415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa441591c0 0x7ffa4415f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35876/0 (socket says 172.21.15.114:35876) 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 -- 172.21.15.114:0/1019392901 learned_addr learned my addr 172.21.15.114:0/1019392901 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa48cbb640 1 --2- 172.21.15.114:0/1019392901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa4409ace0 0x7ffa440b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 -- 172.21.15.114:0/1019392901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa4409ace0 msgr2=0x7ffa440b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 --2- 172.21.15.114:0/1019392901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa4409ace0 0x7ffa440b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 -- 172.21.15.114:0/1019392901 >> v1:172.21.15.130:6789/0 conn(0x7ffa4415f5a0 legacy=0x7ffa4406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.274+0000 7ffa43fff640 1 -- 172.21.15.114:0/1019392901 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4415fa20 con 0x7ffa441591c0 2024-04-13T02:44:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa43fff640 1 --2- 172.21.15.114:0/1019392901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa441591c0 0x7ffa4415f060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009870 tx=0x7ffa3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2310be58343eb4b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa42ffd640 1 -- 172.21.15.114:0/1019392901 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34035020 con 0x7ffa441591c0 2024-04-13T02:44:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa42ffd640 1 -- 172.21.15.114:0/1019392901 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa34031640 con 0x7ffa441591c0 2024-04-13T02:44:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa42ffd640 1 -- 172.21.15.114:0/1019392901 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3402d040 con 0x7ffa441591c0 2024-04-13T02:44:49.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 -- 172.21.15.114:0/1019392901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa441591c0 msgr2=0x7ffa4415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/1019392901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa441591c0 0x7ffa4415f060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009870 tx=0x7ffa3402b8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 -- 172.21.15.114:0/1019392901 shutdown_connections 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/1019392901 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa4409ace0 0x7ffa440b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/1019392901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa441591c0 0x7ffa4415f060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 -- 172.21.15.114:0/1019392901 >> 172.21.15.114:0/1019392901 conn(0x7ffa440b7eb0 msgr2=0x7ffa440b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 -- 172.21.15.114:0/1019392901 shutdown_connections 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.275+0000 7ffa4a71e640 1 -- 172.21.15.114:0/1019392901 wait complete. 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 Processor -- start 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 -- start start 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa4409ace0 0x7ffa441f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa441591c0 0x7ffa4409f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 0x7ffa4409fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffa440b6640 con 0x7ffa4415f5a0 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffa440b6360 con 0x7ffa4409ace0 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.277+0000 7ffa4a71e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4406db60 con 0x7ffa441591c0 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 0x7ffa4409fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 0x7ffa4409fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35878/0 (socket says 172.21.15.114:35878) 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 -- 172.21.15.114:0/3442387753 learned_addr learned my addr 172.21.15.114:0/3442387753 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa43fff640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa4409ace0 0x7ffa441f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa437fe640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa441591c0 0x7ffa4409f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 -- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa441591c0 msgr2=0x7ffa4409f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa441591c0 0x7ffa4409f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 -- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa4409ace0 msgr2=0x7ffa441f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa4409ace0 0x7ffa441f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 -- 172.21.15.114:0/3442387753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa440b4160 con 0x7ffa4415f5a0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa437fe640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa441591c0 0x7ffa4409f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa48cbb640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 0x7ffa4409fe00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c007dc0 tx=0x7ffa3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c014420 con 0x7ffa4415f5a0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3c019070 con 0x7ffa4415f5a0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa44159c00 con 0x7ffa4415f5a0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c014820 con 0x7ffa4415f5a0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.278+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa441f4af0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.279+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa44068c80 con 0x7ffa4415f5a0 2024-04-13T02:44:49.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.280+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa3c0149c0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.280+0000 7ffa40ff9640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ffa3006c8f0 0x7ffa3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.280+0000 7ffa43fff640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ffa3006c8f0 0x7ffa3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.280+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa3c08c2a0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.280+0000 7ffa43fff640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ffa3006c8f0 0x7ffa3006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa34036000 tx=0x7ffa3403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.284+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa3c05a6d0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.458+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffa4406f3a0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.458+0000 7ffa40ff9640 1 -- 172.21.15.114:0/3442387753 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ffa3c059fd0 con 0x7ffa4415f5a0 2024-04-13T02:44:49.460 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ffa3006c8f0 msgr2=0x7ffa3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ffa3006c8f0 0x7ffa3006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa34036000 tx=0x7ffa3403c040 comp rx=0 tx=0).stop 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 msgr2=0x7ffa4409fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 0x7ffa4409fe00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c007dc0 tx=0x7ffa3c00e4b0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 shutdown_connections 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa4415f5a0 0x7ffa4409fe00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ffa3006c8f0 0x7ffa3006edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa441591c0 0x7ffa4409f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 --2- 172.21.15.114:0/3442387753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa4409ace0 0x7ffa441f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 >> 172.21.15.114:0/3442387753 conn(0x7ffa440b7eb0 msgr2=0x7ffa44071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:49.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 shutdown_connections 2024-04-13T02:44:49.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.460+0000 7ffa4a71e640 1 -- 172.21.15.114:0/3442387753 wait complete. 2024-04-13T02:44:49.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:44:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.571+0000 7f8ac800f640 1 Processor -- start 2024-04-13T02:44:49.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.571+0000 7f8ac800f640 1 -- start start 2024-04-13T02:44:49.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac800f640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ac015edb0 0x7f8ac009ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac800f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 0x7f8ac009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac800f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac006cd90 con 0x7f8ac006d450 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac800f640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac00cce20 con 0x7f8ac015edb0 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac800f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac006d070 con 0x7f8ac00b3ec0 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac65ac640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ac006d450 0x7f8ac00c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38046/0 (socket says 172.21.15.114:38046) 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac65ac640 1 -- 172.21.15.114:0/2995897782 learned_addr learned my addr 172.21.15.114:0/2995897782 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353127353 0 0) 0x7f8ac006cd90 con 0x7f8ac006d450 2024-04-13T02:44:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aac003520 con 0x7f8ac006d450 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac5dab640 1 --2- 172.21.15.114:0/2995897782 >> v2:172.21.15.130:3300/0 conn(0x7f8ac015edb0 0x7f8ac009ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.572+0000 7f8ac55aa640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 0x7f8ac009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3910261978 0 0) 0x7f8aac003520 con 0x7f8ac006d450 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 msgr2=0x7f8ac009b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 0x7f8ac009b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 >> v2:172.21.15.130:3300/0 conn(0x7f8ac015edb0 msgr2=0x7f8ac009ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 --2- 172.21.15.114:0/2995897782 >> v2:172.21.15.130:3300/0 conn(0x7f8ac015edb0 0x7f8ac009ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00cd070 con 0x7f8ac006d450 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f8ab80019f0 con 0x7f8ac006d450 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 >> v1:172.21.15.114:6789/0 conn(0x7f8ac006d450 legacy=0x7f8ac00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac0039b0 0x7f8aac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 0x7f8aac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8aac004d40 0x7f8aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00cce20 con 0x7f8aac004d40 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac006d070 con 0x7f8aac0039b0 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac00baa0 con 0x7f8ac00b3ec0 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac65ac640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8aac004d40 0x7f8aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac5dab640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac0039b0 0x7f8aac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac55aa640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 0x7f8aac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac65ac640 1 -- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 msgr2=0x7f8aac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac65ac640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac00b3ec0 0x7f8aac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac65ac640 1 -- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac0039b0 msgr2=0x7f8aac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac65ac640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac0039b0 0x7f8aac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.573+0000 7f8ac65ac640 1 -- 172.21.15.114:0/2995897782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac003520 con 0x7f8aac004d40 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac65ac640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8aac004d40 0x7f8aac0051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800a870 tx=0x7f8aac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6775cac02ece8dde server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800a4c0 con 0x7f8aac004d40 2024-04-13T02:44:49.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab8034630 con 0x7f8aac004d40 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac4da9640 1 -- 172.21.15.114:0/2995897782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8034a20 con 0x7f8aac004d40 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac800f640 1 -- 172.21.15.114:0/2995897782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8aac004d40 msgr2=0x7f8aac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac800f640 1 --2- 172.21.15.114:0/2995897782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8aac004d40 0x7f8aac0051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800a870 tx=0x7f8aac005830 comp rx=0 tx=0).stop 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac65ac640 1 -- 172.21.15.114:0/2995897782 reap_dead start 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac800f640 1 -- 172.21.15.114:0/2995897782 shutdown_connections 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac800f640 1 -- 172.21.15.114:0/2995897782 >> 172.21.15.114:0/2995897782 conn(0x7f8ac00d27d0 msgr2=0x7f8ac00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac800f640 1 -- 172.21.15.114:0/2995897782 shutdown_connections 2024-04-13T02:44:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.574+0000 7f8ac800f640 1 -- 172.21.15.114:0/2995897782 wait complete. 2024-04-13T02:44:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 Processor -- start 2024-04-13T02:44:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 -- start start 2024-04-13T02:44:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac004d40 0x7f8ac0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 0x7f8ac0160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac015ccf0 0x7f8ac0160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00ce860 con 0x7f8ac00b7020 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac006ca40 con 0x7f8aac004d40 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac800f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac00ce9e0 con 0x7f8ac015ccf0 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac55aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 0x7f8ac0160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac55aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 0x7f8ac0160100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35890/0 (socket says 172.21.15.114:35890) 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.576+0000 7f8ac55aa640 1 -- 172.21.15.114:0/3263824836 learned_addr learned my addr 172.21.15.114:0/3263824836 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac65ac640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac015ccf0 0x7f8ac0160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac5dab640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac004d40 0x7f8ac0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac55aa640 1 -- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac015ccf0 msgr2=0x7f8ac0160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac55aa640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac015ccf0 0x7f8ac0160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac55aa640 1 -- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac004d40 msgr2=0x7f8ac0158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac55aa640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac004d40 0x7f8ac0158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac55aa640 1 -- 172.21.15.114:0/3263824836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00b6580 con 0x7f8ac00b7020 2024-04-13T02:44:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac5dab640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac004d40 0x7f8ac0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac65ac640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac015ccf0 0x7f8ac0160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac55aa640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 0x7f8ac0160100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000b820 tx=0x7f8ab000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0018070 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab000be10 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac015f230 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0010c60 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.577+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac00b6b00 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.578+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac0068c80 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.578+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ab001b070 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.579+0000 7f8ab67fc640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8aa406c920 0x7f8aa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.579+0000 7f8ac5dab640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8aa406c920 0x7f8aa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.579+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ab008be80 con 0x7f8ac00b7020 2024-04-13T02:44:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.579+0000 7f8ac5dab640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8aa406c920 0x7f8aa406ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00c9110 tx=0x7f8abc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.583+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ab005a340 con 0x7f8ac00b7020 2024-04-13T02:44:49.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.796+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ac015e120 con 0x7f8ac00b7020 2024-04-13T02:44:49.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.796+0000 7f8ab67fc640 1 -- 172.21.15.114:0/3263824836 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f8ab0059c40 con 0x7f8ac00b7020 2024-04-13T02:44:49.798 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:49.798 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:44:49.798 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.798+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8aa406c920 msgr2=0x7f8aa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8aa406c920 0x7f8aa406ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00c9110 tx=0x7f8abc008040 comp rx=0 tx=0).stop 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 msgr2=0x7f8ac0160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 0x7f8ac0160100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000b820 tx=0x7f8ab000bce0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 shutdown_connections 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8aa406c920 0x7f8aa406ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ac015ccf0 0x7f8ac0160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ac00b7020 0x7f8ac0160100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 --2- 172.21.15.114:0/3263824836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8aac004d40 0x7f8ac0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 >> 172.21.15.114:0/3263824836 conn(0x7f8ac00d27d0 msgr2=0x7f8ac00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:49.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 shutdown_connections 2024-04-13T02:44:49.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.799+0000 7f8ac800f640 1 -- 172.21.15.114:0/3263824836 wait complete. 2024-04-13T02:44:49.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.909+0000 7f88228c8640 1 Processor -- start 2024-04-13T02:44:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.909+0000 7f88228c8640 1 -- start start 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f88228c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f88228c8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f881c1556c0 0x7f881c072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f88228c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881c0b48e0 con 0x7f881c1552e0 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f88228c8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f881c0b38d0 con 0x7f881c1556c0 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f88228c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0b0270 con 0x7f881c15c170 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f8820e65640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f881c1556c0 0x7f881c072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f881bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f881c1552e0 0x7f881c0afb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38048/0 (socket says 172.21.15.114:38048) 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f881bfff640 1 -- 172.21.15.114:0/835467369 learned_addr learned my addr 172.21.15.114:0/835467369 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f881b7fe640 1 --2- 172.21.15.114:0/835467369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f8820e65640 1 -- 172.21.15.114:0/835467369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 msgr2=0x7f881c072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f8820e65640 1 --2- 172.21.15.114:0/835467369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f8820e65640 1 -- 172.21.15.114:0/835467369 >> v1:172.21.15.114:6789/0 conn(0x7f881c1552e0 legacy=0x7f881c0afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.910+0000 7f8820e65640 1 -- 172.21.15.114:0/835467369 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c0b3b20 con 0x7f881c1556c0 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.911+0000 7f8820e65640 1 --2- 172.21.15.114:0/835467369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1556c0 0x7f881c072fb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8814009d90 tx=0x7f881402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85347018d68744c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.911+0000 7f881affd640 1 -- 172.21.15.114:0/835467369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814039070 con 0x7f881c1556c0 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.911+0000 7f881affd640 1 -- 172.21.15.114:0/835467369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881402cc50 con 0x7f881c1556c0 2024-04-13T02:44:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.911+0000 7f881affd640 1 -- 172.21.15.114:0/835467369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814034440 con 0x7f881c1556c0 2024-04-13T02:44:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 -- 172.21.15.114:0/835467369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1556c0 msgr2=0x7f881c072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 --2- 172.21.15.114:0/835467369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1556c0 0x7f881c072fb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8814009d90 tx=0x7f881402bea0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 -- 172.21.15.114:0/835467369 shutdown_connections 2024-04-13T02:44:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 --2- 172.21.15.114:0/835467369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1556c0 0x7f881c072fb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 --2- 172.21.15.114:0/835467369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 -- 172.21.15.114:0/835467369 >> 172.21.15.114:0/835467369 conn(0x7f881c0b27b0 msgr2=0x7f881c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 -- 172.21.15.114:0/835467369 shutdown_connections 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.912+0000 7f88228c8640 1 -- 172.21.15.114:0/835467369 wait complete. 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.913+0000 7f88228c8640 1 Processor -- start 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.913+0000 7f88228c8640 1 -- start start 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 0x7f881c13e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f881c1556c0 0x7f881c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b43c0 con 0x7f881c1552e0 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b40e0 con 0x7f881c1556c0 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0d0110 con 0x7f881c15c170 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 0x7f881c13e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 0x7f881c13e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35906/0 (socket says 172.21.15.114:35906) 2024-04-13T02:44:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 -- 172.21.15.114:0/4253367315 learned_addr learned my addr 172.21.15.114:0/4253367315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881b7fe640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f881c1556c0 0x7f881c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f8820e65640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 -- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 msgr2=0x7f881c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 -- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f881c1556c0 msgr2=0x7f881c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f881c1556c0 0x7f881c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 -- 172.21.15.114:0/4253367315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c152d00 con 0x7f881c1552e0 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f881bfff640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 0x7f881c13e7e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c400 tx=0x7f880c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c017070 con 0x7f881c1552e0 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880c005ce0 con 0x7f881c1552e0 2024-04-13T02:44:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c13f6f0 con 0x7f881c1552e0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c0072f0 con 0x7f881c1552e0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.914+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c13f130 con 0x7f881c1552e0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.915+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c068c80 con 0x7f881c1552e0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.916+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f880c01a070 con 0x7f881c1552e0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.916+0000 7f8818ff9640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f880806c8f0 0x7f880806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.916+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f880c08ae20 con 0x7f881c1552e0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.916+0000 7f881b7fe640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f880806c8f0 0x7f880806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.917+0000 7f881b7fe640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f880806c8f0 0x7f880806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f881c15be90 tx=0x7f8810008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:49.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:49.920+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f880c058c90 con 0x7f881c1552e0 2024-04-13T02:44:50.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.097+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f881c0b56d0 con 0x7f881c1552e0 2024-04-13T02:44:50.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.098+0000 7f8818ff9640 1 -- 172.21.15.114:0/4253367315 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f880c05cf90 con 0x7f881c1552e0 2024-04-13T02:44:50.099 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:50.099 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f880806c8f0 msgr2=0x7f880806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f880806c8f0 0x7f880806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f881c15be90 tx=0x7f8810008040 comp rx=0 tx=0).stop 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 msgr2=0x7f881c13e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 0x7f881c13e7e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c400 tx=0x7f880c00c8c0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 shutdown_connections 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f880806c8f0 0x7f880806edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f881c15c170 0x7f881c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f881c1556c0 0x7f881c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 --2- 172.21.15.114:0/4253367315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c1552e0 0x7f881c13e7e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 >> 172.21.15.114:0/4253367315 conn(0x7f881c0b27b0 msgr2=0x7f881c154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:50.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 shutdown_connections 2024-04-13T02:44:50.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.100+0000 7f88228c8640 1 -- 172.21.15.114:0/4253367315 wait complete. 2024-04-13T02:44:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:44:50.112 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:44:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.214+0000 7fb219911640 1 Processor -- start 2024-04-13T02:44:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.214+0000 7fb219911640 1 -- start start 2024-04-13T02:44:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb219911640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb21415eba0 0x7fb21406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb219911640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb21406d770 0x7fb2140b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb219911640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2140b7bf0 con 0x7fb2140b7260 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb219911640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb21406dbe0 con 0x7fb21406d770 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb219911640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb2140b76f0 con 0x7fb21415eba0 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb2127fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb21406d770 0x7fb2140b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb2127fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb21406d770 0x7fb2140b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35918/0 (socket says 172.21.15.114:35918) 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.215+0000 7fb2127fc640 1 -- 172.21.15.114:0/400327805 learned_addr learned my addr 172.21.15.114:0/400327805 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb212ffd640 1 --2- 172.21.15.114:0/400327805 >> v2:172.21.15.130:3300/0 conn(0x7fb21415eba0 0x7fb21406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb2127fc640 1 -- 172.21.15.114:0/400327805 >> v2:172.21.15.130:3300/0 conn(0x7fb21415eba0 msgr2=0x7fb21406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb2127fc640 1 --2- 172.21.15.114:0/400327805 >> v2:172.21.15.130:3300/0 conn(0x7fb21415eba0 0x7fb21406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb2127fc640 1 -- 172.21.15.114:0/400327805 >> v1:172.21.15.130:6789/0 conn(0x7fb2140b7260 legacy=0x7fb21409ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb2127fc640 1 -- 172.21.15.114:0/400327805 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2140b7910 con 0x7fb21406d770 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb2127fc640 1 --2- 172.21.15.114:0/400327805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21406d770 0x7fb2140b6d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2140b53f0 tx=0x7fb20802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bd5de1d1ca2b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.216+0000 7fb211ffb640 1 -- 172.21.15.114:0/400327805 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208035020 con 0x7fb21406d770 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb211ffb640 1 -- 172.21.15.114:0/400327805 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb208031870 con 0x7fb21406d770 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb211ffb640 1 -- 172.21.15.114:0/400327805 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208031c40 con 0x7fb21406d770 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 -- 172.21.15.114:0/400327805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21406d770 msgr2=0x7fb2140b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 --2- 172.21.15.114:0/400327805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21406d770 0x7fb2140b6d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2140b53f0 tx=0x7fb20802b910 comp rx=0 tx=0).stop 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 -- 172.21.15.114:0/400327805 shutdown_connections 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 --2- 172.21.15.114:0/400327805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21406d770 0x7fb2140b6d20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 --2- 172.21.15.114:0/400327805 >> v2:172.21.15.130:3300/0 conn(0x7fb21415eba0 0x7fb21406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 -- 172.21.15.114:0/400327805 >> 172.21.15.114:0/400327805 conn(0x7fb2140b7e40 msgr2=0x7fb2140b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 -- 172.21.15.114:0/400327805 shutdown_connections 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.217+0000 7fb219911640 1 -- 172.21.15.114:0/400327805 wait complete. 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.218+0000 7fb219911640 1 Processor -- start 2024-04-13T02:44:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.218+0000 7fb219911640 1 -- start start 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb219911640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21406d770 0x7fb21414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb219911640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 0x7fb2140af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb219911640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb21415eba0 0x7fb2140b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb219911640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb21415f890 con 0x7fb2140b7260 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb219911640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb21415f5b0 con 0x7fb21406d770 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb219911640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb21415ef80 con 0x7fb21415eba0 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 0x7fb2140af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 0x7fb2140af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35926/0 (socket says 172.21.15.114:35926) 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 -- 172.21.15.114:0/2749224758 learned_addr learned my addr 172.21.15.114:0/2749224758 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb212ffd640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21406d770 0x7fb21414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2137fe640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb21415eba0 0x7fb2140b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 -- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb21415eba0 msgr2=0x7fb2140b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb21415eba0 0x7fb2140b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 -- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21406d770 msgr2=0x7fb21414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21406d770 0x7fb21414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.219+0000 7fb2127fc640 1 -- 172.21.15.114:0/2749224758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2140aff70 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.220+0000 7fb2127fc640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 0x7fb2140af670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb2080097f0 tx=0x7fb2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.220+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208040070 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.220+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb208030d00 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.220+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208035040 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.220+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2140b0250 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.220+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2140b0810 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.221+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb214068c80 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.221+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb20804b060 con 0x7fb2140b7260 2024-04-13T02:44:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.221+0000 7fb1fbfff640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb20006c8f0 0x7fb20006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.222+0000 7fb212ffd640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb20006c8f0 0x7fb20006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.222+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2080ad7e0 con 0x7fb2140b7260 2024-04-13T02:44:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.222+0000 7fb212ffd640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb20006c8f0 0x7fb20006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2141f7c90 tx=0x7fb2040098d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.226+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb20807bc10 con 0x7fb2140b7260 2024-04-13T02:44:50.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.401+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb21415c9f0 con 0x7fb2140b7260 2024-04-13T02:44:50.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.402+0000 7fb1fbfff640 1 -- 172.21.15.114:0/2749224758 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb20807b510 con 0x7fb2140b7260 2024-04-13T02:44:50.403 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb20006c8f0 msgr2=0x7fb20006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb20006c8f0 0x7fb20006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2141f7c90 tx=0x7fb2040098d0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 msgr2=0x7fb2140af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 0x7fb2140af670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb2080097f0 tx=0x7fb2080046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 shutdown_connections 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb20006c8f0 0x7fb20006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb21415eba0 0x7fb2140b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140b7260 0x7fb2140af670 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 --2- 172.21.15.114:0/2749224758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb21406d770 0x7fb21414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 >> 172.21.15.114:0/2749224758 conn(0x7fb2140b7e40 msgr2=0x7fb2140706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 shutdown_connections 2024-04-13T02:44:50.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.404+0000 7fb219911640 1 -- 172.21.15.114:0/2749224758 wait complete. 2024-04-13T02:44:50.415 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:44:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.518+0000 7fe9b7680640 1 Processor -- start 2024-04-13T02:44:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.518+0000 7fe9b7680640 1 -- start start 2024-04-13T02:44:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b7680640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b00cfbe0 0x7fe9b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b7680640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe9b006d8a0 0x7fe9b00b7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b7680640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b00d35e0 con 0x7fe9b015ed60 2024-04-13T02:44:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b7680640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe9b00d4180 con 0x7fe9b00cfbe0 2024-04-13T02:44:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b7680640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe9b00ba930 con 0x7fe9b006d8a0 2024-04-13T02:44:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b00cfbe0 0x7fe9b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b00cfbe0 0x7fe9b006d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35930/0 (socket says 172.21.15.114:35930) 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 -- 172.21.15.114:0/1914985524 learned_addr learned my addr 172.21.15.114:0/1914985524 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b5c1d640 1 --2- 172.21.15.114:0/1914985524 >> v2:172.21.15.130:3300/0 conn(0x7fe9b006d8a0 0x7fe9b00b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 -- 172.21.15.114:0/1914985524 >> v2:172.21.15.130:3300/0 conn(0x7fe9b006d8a0 msgr2=0x7fe9b00b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 --2- 172.21.15.114:0/1914985524 >> v2:172.21.15.130:3300/0 conn(0x7fe9b006d8a0 0x7fe9b00b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 -- 172.21.15.114:0/1914985524 >> v1:172.21.15.130:6789/0 conn(0x7fe9b015ed60 legacy=0x7fe9b00ba220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.519+0000 7fe9b4c1b640 1 -- 172.21.15.114:0/1914985524 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b015f140 con 0x7fe9b00cfbe0 2024-04-13T02:44:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.520+0000 7fe9b4c1b640 1 --2- 172.21.15.114:0/1914985524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b006d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0068670 tx=0x7fe9a002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804c43251c69a6d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.520+0000 7fe9a7fff640 1 -- 172.21.15.114:0/1914985524 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002f850 con 0x7fe9b00cfbe0 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.520+0000 7fe9a7fff640 1 -- 172.21.15.114:0/1914985524 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a002f9f0 con 0x7fe9b00cfbe0 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.520+0000 7fe9a7fff640 1 -- 172.21.15.114:0/1914985524 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002fdc0 con 0x7fe9b00cfbe0 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 -- 172.21.15.114:0/1914985524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b00cfbe0 msgr2=0x7fe9b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 --2- 172.21.15.114:0/1914985524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b006d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0068670 tx=0x7fe9a002ba30 comp rx=0 tx=0).stop 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 -- 172.21.15.114:0/1914985524 shutdown_connections 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 --2- 172.21.15.114:0/1914985524 >> v2:172.21.15.130:3300/0 conn(0x7fe9b006d8a0 0x7fe9b00b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 --2- 172.21.15.114:0/1914985524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b006d360 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 -- 172.21.15.114:0/1914985524 >> 172.21.15.114:0/1914985524 conn(0x7fe9b00d4d70 msgr2=0x7fe9b00d5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 -- 172.21.15.114:0/1914985524 shutdown_connections 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.521+0000 7fe9b7680640 1 -- 172.21.15.114:0/1914985524 wait complete. 2024-04-13T02:44:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.522+0000 7fe9b7680640 1 Processor -- start 2024-04-13T02:44:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.522+0000 7fe9b7680640 1 -- start start 2024-04-13T02:44:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 0x7fe9b00cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b0154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b015ed60 0x7fe9b00ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00d3e10 con 0x7fe9b006d8a0 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00d3b30 con 0x7fe9b00cfbe0 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b00d4610 con 0x7fe9b015ed60 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 0x7fe9b00cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 0x7fe9b00cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35932/0 (socket says 172.21.15.114:35932) 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 -- 172.21.15.114:0/2898316721 learned_addr learned my addr 172.21.15.114:0/2898316721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b5c1d640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b015ed60 0x7fe9b00ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b4c1b640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b0154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 -- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b015ed60 msgr2=0x7fe9b00ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b015ed60 0x7fe9b00ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 -- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b00cfbe0 msgr2=0x7fe9b0154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b0154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 -- 172.21.15.114:0/2898316721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b00cd1b0 con 0x7fe9b006d8a0 2024-04-13T02:44:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b5c1d640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b015ed60 0x7fe9b00ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b4c1b640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b0154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b541c640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 0x7fe9b00cee90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00c730 tx=0x7fe9ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac016020 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac006d50 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b00cd450 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.523+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac003bb0 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.524+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b00cda10 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.524+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b0068c80 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.525+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9ac00a850 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.525+0000 7fe9a5ffb640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe99406c8f0 0x7fe99406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.525+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ac08b7a0 con 0x7fe9b006d8a0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.525+0000 7fe9b4c1b640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe99406c8f0 0x7fe99406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.526+0000 7fe9b4c1b640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe99406c8f0 0x7fe99406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0036000 tx=0x7fe9a0039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.529+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9ac020020 con 0x7fe9b006d8a0 2024-04-13T02:44:50.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.704+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe9b00b8100 con 0x7fe9b006d8a0 2024-04-13T02:44:50.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.704+0000 7fe9a5ffb640 1 -- 172.21.15.114:0/2898316721 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe9ac019310 con 0x7fe9b006d8a0 2024-04-13T02:44:50.705 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe99406c8f0 msgr2=0x7fe99406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe99406c8f0 0x7fe99406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0036000 tx=0x7fe9a0039040 comp rx=0 tx=0).stop 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 msgr2=0x7fe9b00cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 0x7fe9b00cee90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00c730 tx=0x7fe9ac00cbf0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 shutdown_connections 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe99406c8f0 0x7fe99406edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b015ed60 0x7fe9b00ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b00cfbe0 0x7fe9b0154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 --2- 172.21.15.114:0/2898316721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b006d8a0 0x7fe9b00cee90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 >> 172.21.15.114:0/2898316721 conn(0x7fe9b00d4d70 msgr2=0x7fe9b00b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:50.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 shutdown_connections 2024-04-13T02:44:50.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.706+0000 7fe9b7680640 1 -- 172.21.15.114:0/2898316721 wait complete. 2024-04-13T02:44:50.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:44:50.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.819+0000 7ff85399c640 1 Processor -- start 2024-04-13T02:44:50.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.819+0000 7ff85399c640 1 -- start start 2024-04-13T02:44:50.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff85399c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c09b230 0x7ff84c0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff85399c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff84c06e2f0 0x7ff84c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff85399c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c071330 con 0x7ff84c0ce650 2024-04-13T02:44:50.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff85399c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff84c09bb40 con 0x7ff84c06e2f0 2024-04-13T02:44:50.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff85399c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c06ce50 con 0x7ff84c09b230 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff851738640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff84c0ce650 0x7ff84c09ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38050/0 (socket says 172.21.15.114:38050) 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff851738640 1 -- 172.21.15.114:0/3600814865 learned_addr learned my addr 172.21.15.114:0/3600814865 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff850f37640 1 --2- 172.21.15.114:0/3600814865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c09b230 0x7ff84c0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff851f39640 1 --2- 172.21.15.114:0/3600814865 >> v2:172.21.15.130:3300/0 conn(0x7ff84c06e2f0 0x7ff84c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff843fff640 1 -- 172.21.15.114:0/3600814865 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003501982 0 0) 0x7ff84c071330 con 0x7ff84c0ce650 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff843fff640 1 -- 172.21.15.114:0/3600814865 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff838003520 con 0x7ff84c0ce650 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff850f37640 1 -- 172.21.15.114:0/3600814865 >> v2:172.21.15.130:3300/0 conn(0x7ff84c06e2f0 msgr2=0x7ff84c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff850f37640 1 --2- 172.21.15.114:0/3600814865 >> v2:172.21.15.130:3300/0 conn(0x7ff84c06e2f0 0x7ff84c0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff850f37640 1 -- 172.21.15.114:0/3600814865 >> v1:172.21.15.114:6789/0 conn(0x7ff84c0ce650 legacy=0x7ff84c09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff843fff640 1 -- 172.21.15.114:0/3600814865 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258866791 0 0) 0x7ff838003520 con 0x7ff84c0ce650 2024-04-13T02:44:50.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.820+0000 7ff850f37640 1 -- 172.21.15.114:0/3600814865 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c06cae0 con 0x7ff84c09b230 2024-04-13T02:44:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.821+0000 7ff850f37640 1 --2- 172.21.15.114:0/3600814865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c09b230 0x7ff84c0d07b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0097a0 tx=0x7ff83c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccd56f25ed95f595 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.821+0000 7ff843fff640 1 -- 172.21.15.114:0/3600814865 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c037070 con 0x7ff84c09b230 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.821+0000 7ff843fff640 1 -- 172.21.15.114:0/3600814865 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c030510 con 0x7ff84c09b230 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.821+0000 7ff843fff640 1 -- 172.21.15.114:0/3600814865 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848001670 con 0x7ff84c09b230 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 -- 172.21.15.114:0/3600814865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c09b230 msgr2=0x7ff84c0d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 --2- 172.21.15.114:0/3600814865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c09b230 0x7ff84c0d07b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0097a0 tx=0x7ff83c02b790 comp rx=0 tx=0).stop 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 -- 172.21.15.114:0/3600814865 shutdown_connections 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 --2- 172.21.15.114:0/3600814865 >> v2:172.21.15.130:3300/0 conn(0x7ff84c06e2f0 0x7ff84c0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 --2- 172.21.15.114:0/3600814865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c09b230 0x7ff84c0d07b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 -- 172.21.15.114:0/3600814865 >> 172.21.15.114:0/3600814865 conn(0x7ff84c0d2720 msgr2=0x7ff84c0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 -- 172.21.15.114:0/3600814865 shutdown_connections 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.822+0000 7ff85399c640 1 -- 172.21.15.114:0/3600814865 wait complete. 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.823+0000 7ff85399c640 1 Processor -- start 2024-04-13T02:44:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.823+0000 7ff85399c640 1 -- start start 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff84c06e2f0 0x7ff84c0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 0x7ff84c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c0ce650 0x7ff84c0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c09bd90 con 0x7ff84c09b230 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c071610 con 0x7ff84c06e2f0 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0cea30 con 0x7ff84c0ce650 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 0x7ff84c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 0x7ff84c154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35940/0 (socket says 172.21.15.114:35940) 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 -- 172.21.15.114:0/1978544403 learned_addr learned my addr 172.21.15.114:0/1978544403 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff851f39640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c0ce650 0x7ff84c0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff851738640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff84c06e2f0 0x7ff84c0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 -- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c0ce650 msgr2=0x7ff84c0b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c0ce650 0x7ff84c0b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 -- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff84c06e2f0 msgr2=0x7ff84c0c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff84c06e2f0 0x7ff84c0c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 -- 172.21.15.114:0/1978544403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c0b6250 con 0x7ff84c09b230 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff850f37640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 0x7ff84c154b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff83c02b7d0 tx=0x7ff83c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c041030 con 0x7ff84c09b230 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c03c670 con 0x7ff84c09b230 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c037040 con 0x7ff84c09b230 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.824+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c0b6530 con 0x7ff84c09b230 2024-04-13T02:44:50.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.825+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c0ca950 con 0x7ff84c09b230 2024-04-13T02:44:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.825+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84c068c80 con 0x7ff84c09b230 2024-04-13T02:44:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.826+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff83c044070 con 0x7ff84c09b230 2024-04-13T02:44:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.826+0000 7ff841ffb640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.826+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff83c0ad260 con 0x7ff84c09b230 2024-04-13T02:44:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.826+0000 7ff851738640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:50.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.827+0000 7ff851738640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff83006c8f0 0x7ff83006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff848001320 tx=0x7ff8480012b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:50.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:50.831+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff83c07b040 con 0x7ff84c09b230 2024-04-13T02:44:51.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.005+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff84c0d1460 con 0x7ff84c09b230 2024-04-13T02:44:51.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.005+0000 7ff841ffb640 1 -- 172.21.15.114:0/1978544403 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff83c07f340 con 0x7ff84c09b230 2024-04-13T02:44:51.006 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:44:51.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff83006c8f0 msgr2=0x7ff83006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff83006c8f0 0x7ff83006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff848001320 tx=0x7ff8480012b0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 msgr2=0x7ff84c154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 0x7ff84c154b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff83c02b7d0 tx=0x7ff83c0046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 shutdown_connections 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff84c0ce650 0x7ff84c0b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff84c09b230 0x7ff84c154b70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.007+0000 7ff85399c640 1 --2- 172.21.15.114:0/1978544403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff84c06e2f0 0x7ff84c0c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.008+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 >> 172.21.15.114:0/1978544403 conn(0x7ff84c0d2720 msgr2=0x7ff84c0b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.008+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 shutdown_connections 2024-04-13T02:44:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.008+0000 7ff85399c640 1 -- 172.21.15.114:0/1978544403 wait complete. 2024-04-13T02:44:51.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:44:51.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.118+0000 7f3c758de640 1 Processor -- start 2024-04-13T02:44:51.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.118+0000 7f3c758de640 1 -- start start 2024-04-13T02:44:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c758de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c700ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c758de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c700cedf0 0x7f3c700b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c758de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c700b4be0 con 0x7f3c700b3e10 2024-04-13T02:44:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c758de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3c700a9640 con 0x7f3c700cedf0 2024-04-13T02:44:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c758de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3c700cf250 con 0x7f3c701461f0 2024-04-13T02:44:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c667fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c700cedf0 0x7f3c700b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c667fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c700cedf0 0x7f3c700b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35948/0 (socket says 172.21.15.114:35948) 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.119+0000 7f3c667fc640 1 -- 172.21.15.114:0/1947322706 learned_addr learned my addr 172.21.15.114:0/1947322706 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c6effd640 1 --2- 172.21.15.114:0/1947322706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c700ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c667fc640 1 -- 172.21.15.114:0/1947322706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 msgr2=0x7f3c700ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c667fc640 1 --2- 172.21.15.114:0/1947322706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c700ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c667fc640 1 -- 172.21.15.114:0/1947322706 >> v1:172.21.15.130:6789/0 conn(0x7f3c700b3e10 legacy=0x7f3c700cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c667fc640 1 -- 172.21.15.114:0/1947322706 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c700b4620 con 0x7f3c700cedf0 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c667fc640 1 --2- 172.21.15.114:0/1947322706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c700b38d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c580098a0 tx=0x7f3c5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff76d262a60551cc server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.120+0000 7f3c6e7fc640 1 -- 172.21.15.114:0/1947322706 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58035020 con 0x7f3c700cedf0 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c6e7fc640 1 -- 172.21.15.114:0/1947322706 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c58031640 con 0x7f3c700cedf0 2024-04-13T02:44:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c6e7fc640 1 -- 172.21.15.114:0/1947322706 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5802d040 con 0x7f3c700cedf0 2024-04-13T02:44:51.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 -- 172.21.15.114:0/1947322706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 msgr2=0x7f3c700b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 --2- 172.21.15.114:0/1947322706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c700b38d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c580098a0 tx=0x7f3c5802b8f0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 -- 172.21.15.114:0/1947322706 shutdown_connections 2024-04-13T02:44:51.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 --2- 172.21.15.114:0/1947322706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c700b38d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 --2- 172.21.15.114:0/1947322706 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c700ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 -- 172.21.15.114:0/1947322706 >> 172.21.15.114:0/1947322706 conn(0x7f3c700b27b0 msgr2=0x7f3c700b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 -- 172.21.15.114:0/1947322706 shutdown_connections 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.121+0000 7f3c758de640 1 -- 172.21.15.114:0/1947322706 wait complete. 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.122+0000 7f3c758de640 1 Processor -- start 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.122+0000 7f3c758de640 1 -- start start 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c758de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c700b3e10 0x7f3c7006f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c758de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c7013cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c758de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c7013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c758de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7015d290 con 0x7f3c700cedf0 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c758de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7015cfb0 con 0x7f3c700b3e10 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c758de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3c701465d0 con 0x7f3c701461f0 2024-04-13T02:44:51.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c7013cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c7013cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35952/0 (socket says 172.21.15.114:35952) 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 -- 172.21.15.114:0/2900722411 learned_addr learned my addr 172.21.15.114:0/2900722411 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c6effd640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c700b3e10 0x7f3c7006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c6f7fe640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c7013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 -- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 msgr2=0x7f3c7013d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c7013d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 -- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c700b3e10 msgr2=0x7f3c7006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.123+0000 7f3c667fc640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c700b3e10 0x7f3c7006f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c667fc640 1 -- 172.21.15.114:0/2900722411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7006e3c0 con 0x7f3c700cedf0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c667fc640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c7013cca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58040070 con 0x7f3c700cedf0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c580399f0 con 0x7f3c700cedf0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7006e6a0 con 0x7f3c700cedf0 2024-04-13T02:44:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58035040 con 0x7f3c700cedf0 2024-04-13T02:44:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.124+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7006ec60 con 0x7f3c700cedf0 2024-04-13T02:44:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.125+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c700d0000 con 0x7f3c700cedf0 2024-04-13T02:44:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.125+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c5804b060 con 0x7f3c700cedf0 2024-04-13T02:44:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.126+0000 7f3c6cff9640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3c5006c8f0 0x7f3c5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.126+0000 7f3c6effd640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3c5006c8f0 0x7f3c5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.126+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3c580ad460 con 0x7f3c700cedf0 2024-04-13T02:44:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.126+0000 7f3c6effd640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3c5006c8f0 0x7f3c5006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006fd0 tx=0x7f3c60008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.130+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c700d0000 con 0x7f3c700cedf0 2024-04-13T02:44:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.344+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c70068c80 con 0x7f3c700cedf0 2024-04-13T02:44:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.345+0000 7f3c6cff9640 1 -- 172.21.15.114:0/2900722411 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f3c5807b890 con 0x7f3c700cedf0 2024-04-13T02:44:51.346 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:51.346 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:44:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3c5006c8f0 msgr2=0x7f3c5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3c5006c8f0 0x7f3c5006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006fd0 tx=0x7f3c60008040 comp rx=0 tx=0).stop 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 msgr2=0x7f3c7013cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c7013cca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c580046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 shutdown_connections 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3c5006c8f0 0x7f3c5006edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c701461f0 0x7f3c7013d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c700cedf0 0x7f3c7013cca0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 --2- 172.21.15.114:0/2900722411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c700b3e10 0x7f3c7006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 >> 172.21.15.114:0/2900722411 conn(0x7f3c700b27b0 msgr2=0x7f3c700b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 shutdown_connections 2024-04-13T02:44:51.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.347+0000 7f3c758de640 1 -- 172.21.15.114:0/2900722411 wait complete. 2024-04-13T02:44:51.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:44:51.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.458+0000 7fac356de640 1 Processor -- start 2024-04-13T02:44:51.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.458+0000 7fac356de640 1 -- start start 2024-04-13T02:44:51.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac356de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fac300d1300 0x7fac300d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac356de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 0x7fac300b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac356de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac300d2d90 con 0x7fac3015eac0 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac356de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fac300d1cd0 con 0x7fac300d1300 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac356de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac300d3070 con 0x7fac300b3470 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fac3015eac0 0x7fac300d3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38062/0 (socket says 172.21.15.114:38062) 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2effd640 1 -- 172.21.15.114:0/2877729941 learned_addr learned my addr 172.21.15.114:0/2877729941 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456872690 0 0) 0x7fac300d2d90 con 0x7fac3015eac0 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac1c003520 con 0x7fac3015eac0 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2f7fe640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 0x7fac300b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac27fff640 1 --2- 172.21.15.114:0/2877729941 >> v2:172.21.15.130:3300/0 conn(0x7fac300d1300 0x7fac300d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2177646203 0 0) 0x7fac1c003520 con 0x7fac3015eac0 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 msgr2=0x7fac300b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 0x7fac300b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 >> v2:172.21.15.130:3300/0 conn(0x7fac300d1300 msgr2=0x7fac300d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 --2- 172.21.15.114:0/2877729941 >> v2:172.21.15.130:3300/0 conn(0x7fac300d1300 0x7fac300d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac300d3350 con 0x7fac3015eac0 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fac20001670 con 0x7fac3015eac0 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 >> v1:172.21.15.114:6789/0 conn(0x7fac3015eac0 legacy=0x7fac300d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.459+0000 7fac2e7fc640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac1c0039b0 0x7fac1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2e7fc640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac1c004800 0x7fac1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2e7fc640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 0x7fac1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac300d1cd0 con 0x7fac1c004800 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac300d3070 con 0x7fac1c0039b0 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c00ba70 con 0x7fac300b3470 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac27fff640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac1c004800 0x7fac1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2effd640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac1c0039b0 0x7fac1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2f7fe640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 0x7fac1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac27fff640 1 -- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 msgr2=0x7fac1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac27fff640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac300b3470 0x7fac1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac27fff640 1 -- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac1c0039b0 msgr2=0x7fac1c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac27fff640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac1c0039b0 0x7fac1c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac27fff640 1 -- 172.21.15.114:0/2877729941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c003520 con 0x7fac1c004800 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.460+0000 7fac2effd640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac1c0039b0 0x7fac1c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac27fff640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac1c004800 0x7fac1c004c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac1800ba00 tx=0x7fac1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e344907647c1df5d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18036020 con 0x7fac1c004800 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac18032630 con 0x7fac1c004800 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac2e7fc640 1 -- 172.21.15.114:0/2877729941 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1800b600 con 0x7fac1c004800 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac356de640 1 -- 172.21.15.114:0/2877729941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac1c004800 msgr2=0x7fac1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac356de640 1 --2- 172.21.15.114:0/2877729941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac1c004800 0x7fac1c004c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac1800ba00 tx=0x7fac1c005830 comp rx=0 tx=0).stop 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac2f7fe640 1 -- 172.21.15.114:0/2877729941 reap_dead start 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac356de640 1 -- 172.21.15.114:0/2877729941 shutdown_connections 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac356de640 1 -- 172.21.15.114:0/2877729941 >> 172.21.15.114:0/2877729941 conn(0x7fac30073690 msgr2=0x7fac3006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac356de640 1 -- 172.21.15.114:0/2877729941 shutdown_connections 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.461+0000 7fac356de640 1 -- 172.21.15.114:0/2877729941 wait complete. 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.462+0000 7fac356de640 1 Processor -- start 2024-04-13T02:44:51.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.462+0000 7fac356de640 1 -- start start 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac356de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac1c004800 0x7fac3014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac356de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 0x7fac300b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac356de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac301f7910 0x7fac301f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac356de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac3015eea0 con 0x7fac300b5a20 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac356de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac300d3910 con 0x7fac301f7910 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac356de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac300d4590 con 0x7fac1c004800 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 0x7fac300b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 0x7fac300b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35982/0 (socket says 172.21.15.114:35982) 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 -- 172.21.15.114:0/185871187 learned_addr learned my addr 172.21.15.114:0/185871187 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac2effd640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac1c004800 0x7fac3014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac2f7fe640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac301f7910 0x7fac301f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 -- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac1c004800 msgr2=0x7fac3014fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac1c004800 0x7fac3014fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 -- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac301f7910 msgr2=0x7fac301f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac301f7910 0x7fac301f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac27fff640 1 -- 172.21.15.114:0/185871187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac301f8300 con 0x7fac300b5a20 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.463+0000 7fac2f7fe640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac301f7910 0x7fac301f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.464+0000 7fac27fff640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 0x7fac300b5ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac18035040 tx=0x7fac18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.464+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18041070 con 0x7fac300b5a20 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.464+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac18030a40 con 0x7fac300b5a20 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.464+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac301f85d0 con 0x7fac300b5a20 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.464+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18036040 con 0x7fac300b5a20 2024-04-13T02:44:51.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.464+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac300ab870 con 0x7fac300b5a20 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.465+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac300b63e0 con 0x7fac300b5a20 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.465+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac18039020 con 0x7fac300b5a20 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.465+0000 7fac277fe640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac1006c8f0 0x7fac1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.466+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac180adc40 con 0x7fac300b5a20 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.466+0000 7fac2effd640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac1006c8f0 0x7fac1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.466+0000 7fac2effd640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac1006c8f0 0x7fac1006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac20001840 tx=0x7fac20007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.470+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac1807c100 con 0x7fac300b5a20 2024-04-13T02:44:51.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.648+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac30068c80 con 0x7fac300b5a20 2024-04-13T02:44:51.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.650+0000 7fac277fe640 1 -- 172.21.15.114:0/185871187 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fac1807ba00 con 0x7fac300b5a20 2024-04-13T02:44:51.650 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:51.651 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:44:51.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.651+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac1006c8f0 msgr2=0x7fac1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.651+0000 7fac356de640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac1006c8f0 0x7fac1006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac20001840 tx=0x7fac20007040 comp rx=0 tx=0).stop 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.651+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 msgr2=0x7fac300b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.651+0000 7fac356de640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 0x7fac300b5ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac18035040 tx=0x7fac18004730 comp rx=0 tx=0).stop 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 shutdown_connections 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac301f7910 0x7fac301f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300b5a20 0x7fac300b5ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac1006c8f0 0x7fac1006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 --2- 172.21.15.114:0/185871187 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac1c004800 0x7fac3014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 >> 172.21.15.114:0/185871187 conn(0x7fac30073690 msgr2=0x7fac3015f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 shutdown_connections 2024-04-13T02:44:51.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.652+0000 7fac356de640 1 -- 172.21.15.114:0/185871187 wait complete. 2024-04-13T02:44:51.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:44:51.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.763+0000 7f1a6d677640 1 Processor -- start 2024-04-13T02:44:51.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.763+0000 7f1a6d677640 1 -- start start 2024-04-13T02:44:51.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a6d677640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a6809b1e0 0x7f1a6809b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a6d677640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a680c95e0 con 0x7f1a680cedf0 2024-04-13T02:44:51.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a6d677640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a680d0320 con 0x7f1a6809ae00 2024-04-13T02:44:51.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a6d677640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1a68160520 con 0x7f1a6809b1e0 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a677fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a6809b1e0 0x7f1a6809b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a667fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1a680cedf0 0x7f1a680cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38068/0 (socket says 172.21.15.114:38068) 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.764+0000 7f1a667fc640 1 -- 172.21.15.114:0/2007998535 learned_addr learned my addr 172.21.15.114:0/2007998535 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.765+0000 7f1a677fe640 1 -- 172.21.15.114:0/2007998535 >> v1:172.21.15.130:6789/0 conn(0x7f1a6809ae00 legacy=0x7f1a680cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.765+0000 7f1a677fe640 1 -- 172.21.15.114:0/2007998535 >> v1:172.21.15.114:6789/0 conn(0x7f1a680cedf0 legacy=0x7f1a680cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.765+0000 7f1a65ffb640 1 -- 172.21.15.114:0/2007998535 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161392661 0 0) 0x7f1a680c95e0 con 0x7f1a680cedf0 2024-04-13T02:44:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.765+0000 7f1a677fe640 1 -- 172.21.15.114:0/2007998535 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a680d05e0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.765+0000 7f1a677fe640 1 --2- 172.21.15.114:0/2007998535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a6809b970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097a0 tx=0x7f1a6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f093fd0f4562ff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a65ffb640 1 -- 172.21.15.114:0/2007998535 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a600315a0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a65ffb640 1 -- 172.21.15.114:0/2007998535 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a60037070 con 0x7f1a6809b1e0 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a65ffb640 1 -- 172.21.15.114:0/2007998535 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60031960 con 0x7f1a6809b1e0 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 -- 172.21.15.114:0/2007998535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 msgr2=0x7f1a6809b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 --2- 172.21.15.114:0/2007998535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a6809b970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097a0 tx=0x7f1a6002b840 comp rx=0 tx=0).stop 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 -- 172.21.15.114:0/2007998535 shutdown_connections 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 --2- 172.21.15.114:0/2007998535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a6809b970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 -- 172.21.15.114:0/2007998535 >> 172.21.15.114:0/2007998535 conn(0x7f1a680d2750 msgr2=0x7f1a680d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 -- 172.21.15.114:0/2007998535 shutdown_connections 2024-04-13T02:44:51.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.766+0000 7f1a6d677640 1 -- 172.21.15.114:0/2007998535 wait complete. 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.767+0000 7f1a6d677640 1 Processor -- start 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.767+0000 7f1a6d677640 1 -- start start 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a6d677640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6809ae00 0x7f1a68153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a6d677640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a680b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a6d677640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680cedf0 0x7f1a680b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a6d677640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68160f70 con 0x7f1a6809b1e0 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a6d677640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68160770 con 0x7f1a6809ae00 2024-04-13T02:44:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a6d677640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1a681610f0 con 0x7f1a680cedf0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a667fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a680b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a667fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a680b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35996/0 (socket says 172.21.15.114:35996) 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a667fc640 1 -- 172.21.15.114:0/4062954486 learned_addr learned my addr 172.21.15.114:0/4062954486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a66ffd640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6809ae00 0x7f1a68153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.768+0000 7f1a677fe640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680cedf0 0x7f1a680b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a667fc640 1 -- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680cedf0 msgr2=0x7f1a680b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a667fc640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680cedf0 0x7f1a680b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a667fc640 1 -- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6809ae00 msgr2=0x7f1a68153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a667fc640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6809ae00 0x7f1a68153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a667fc640 1 -- 172.21.15.114:0/4062954486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a680b64e0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a667fc640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a680b0050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c3e0 tx=0x7f1a5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0074e0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0047e0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c004bd0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a680b67c0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.769+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a680b6d80 con 0x7f1a6809b1e0 2024-04-13T02:44:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.770+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a68068c80 con 0x7f1a6809b1e0 2024-04-13T02:44:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.770+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a5c011070 con 0x7f1a6809b1e0 2024-04-13T02:44:51.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.771+0000 7f1a4f7fe640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1a5406c8f0 0x7f1a5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:51.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.771+0000 7f1a66ffd640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1a5406c8f0 0x7f1a5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:51.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.771+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a5c08b780 con 0x7f1a6809b1e0 2024-04-13T02:44:51.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.771+0000 7f1a66ffd640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1a5406c8f0 0x7f1a5406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005520 tx=0x7f1a58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.775+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a5c059bb0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.985+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a6815fe60 con 0x7f1a6809b1e0 2024-04-13T02:44:51.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.986+0000 7f1a4f7fe640 1 -- 172.21.15.114:0/4062954486 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f1a5c0594b0 con 0x7f1a6809b1e0 2024-04-13T02:44:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:44:51.987 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:44:51.987 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:44:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1a5406c8f0 msgr2=0x7f1a5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1a5406c8f0 0x7f1a5406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a58005520 tx=0x7f1a58009040 comp rx=0 tx=0).stop 2024-04-13T02:44:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 msgr2=0x7f1a680b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a680b0050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c3e0 tx=0x7f1a5c00c8a0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 shutdown_connections 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1a5406c8f0 0x7f1a5406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680cedf0 0x7f1a680b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a6809b1e0 0x7f1a680b0050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 --2- 172.21.15.114:0/4062954486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a6809ae00 0x7f1a68153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 >> 172.21.15.114:0/4062954486 conn(0x7f1a680d2750 msgr2=0x7f1a680cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 shutdown_connections 2024-04-13T02:44:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:51.988+0000 7f1a6d677640 1 -- 172.21.15.114:0/4062954486 wait complete. 2024-04-13T02:44:52.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-13T02:44:39.559594+0000', 'modified': '2024-04-13T02:44:41.561259+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6835/3235541552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6833', 'nonce': 3235541552}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 3235541552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-04-13T02:44:52.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-13T02:44:52.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-13T02:44:52.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.506+0000 7f2b8d860640 1 Processor -- start 2024-04-13T02:44:52.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.506+0000 7f2b8d860640 1 -- start start 2024-04-13T02:44:52.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.506+0000 7f2b8d860640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b88161fc0 0x7f2b88163090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.506+0000 7f2b8d860640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b880d2d20 con 0x7f2b880d48a0 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.506+0000 7f2b8d860640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b880cff70 con 0x7f2b880cf9b0 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.506+0000 7f2b8d860640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f2b880d2fc0 con 0x7f2b88161fc0 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b86ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b88161fc0 0x7f2b88163090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b86ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b88161fc0 0x7f2b88163090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36000/0 (socket says 172.21.15.114:36000) 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b86ffd640 1 -- 172.21.15.114:0/2224580679 learned_addr learned my addr 172.21.15.114:0/2224580679 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b877fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2b880d48a0 0x7f2b880d3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38084/0 (socket says 172.21.15.114:38084) 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b86ffd640 1 -- 172.21.15.114:0/2224580679 >> v1:172.21.15.130:6789/0 conn(0x7f2b880cf9b0 legacy=0x7f2b880b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b86ffd640 1 -- 172.21.15.114:0/2224580679 >> v1:172.21.15.114:6789/0 conn(0x7f2b880d48a0 legacy=0x7f2b880d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b867fc640 1 -- 172.21.15.114:0/2224580679 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793940687 0 0) 0x7f2b880d2d20 con 0x7f2b880d48a0 2024-04-13T02:44:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.507+0000 7f2b86ffd640 1 -- 172.21.15.114:0/2224580679 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b880d32a0 con 0x7f2b88161fc0 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/2224580679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88161fc0 0x7f2b88163090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009870 tx=0x7f2b7802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4820ce8ea32ff146 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b867fc640 1 -- 172.21.15.114:0/2224580679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78034070 con 0x7f2b88161fc0 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b867fc640 1 -- 172.21.15.114:0/2224580679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78030860 con 0x7f2b88161fc0 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b867fc640 1 -- 172.21.15.114:0/2224580679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78030c30 con 0x7f2b88161fc0 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 -- 172.21.15.114:0/2224580679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88161fc0 msgr2=0x7f2b88163090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 --2- 172.21.15.114:0/2224580679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88161fc0 0x7f2b88163090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009870 tx=0x7f2b7802b9a0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 -- 172.21.15.114:0/2224580679 shutdown_connections 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 --2- 172.21.15.114:0/2224580679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88161fc0 0x7f2b88163090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 -- 172.21.15.114:0/2224580679 >> 172.21.15.114:0/2224580679 conn(0x7f2b88073480 msgr2=0x7f2b88073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 -- 172.21.15.114:0/2224580679 shutdown_connections 2024-04-13T02:44:52.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.508+0000 7f2b8d860640 1 -- 172.21.15.114:0/2224580679 wait complete. 2024-04-13T02:44:52.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 Processor -- start 2024-04-13T02:44:52.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 -- start start 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 0x7f2b880cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b880d48a0 0x7f2b880cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b88161fc0 0x7f2b88153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880d41b0 con 0x7f2b880cf9b0 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881623a0 con 0x7f2b88161fc0 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.510+0000 7f2b8d860640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2b880d4330 con 0x7f2b880d48a0 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 0x7f2b880cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 0x7f2b880cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36008/0 (socket says 172.21.15.114:36008) 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 -- 172.21.15.114:0/367238726 learned_addr learned my addr 172.21.15.114:0/367238726 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b880d48a0 0x7f2b880cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 -- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b880d48a0 msgr2=0x7f2b880cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b877fe640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b88161fc0 0x7f2b88153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b880d48a0 0x7f2b880cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 -- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b88161fc0 msgr2=0x7f2b88153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b88161fc0 0x7f2b88153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 -- 172.21.15.114:0/367238726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b880ce3e0 con 0x7f2b880cf9b0 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b877fe640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b88161fc0 0x7f2b88153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 0x7f2b880cf240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b780090b0 tx=0x7f2b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b84ff9640 1 -- 172.21.15.114:0/367238726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78034040 con 0x7f2b880cf9b0 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b84ff9640 1 -- 172.21.15.114:0/367238726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7803ab90 con 0x7f2b880cf9b0 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b881541f0 con 0x7f2b880cf9b0 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b84ff9640 1 -- 172.21.15.114:0/367238726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78004030 con 0x7f2b880cf9b0 2024-04-13T02:44:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.511+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b880cde20 con 0x7f2b880cf9b0 2024-04-13T02:44:52.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.513+0000 7f2b84ff9640 1 -- 172.21.15.114:0/367238726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b78037070 con 0x7f2b880cf9b0 2024-04-13T02:44:52.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.513+0000 7f2b84ff9640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2b6806c920 0x7f2b6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.513+0000 7f2b84ff9640 1 -- 172.21.15.114:0/367238726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b780adc20 con 0x7f2b880cf9b0 2024-04-13T02:44:52.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.513+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2b6806c920 0x7f2b6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.514+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2b6806c920 0x7f2b6806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2b880b35b0 tx=0x7f2b70009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.514+0000 7f2b90652740 1 Processor -- start 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.514+0000 7f2b90652740 1 -- start start 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75cdde0 0x555be75a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b90652740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75a12c0 0x555be75d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b90652740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x555be750b990 con 0x555be75ce1c0 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555be74b2620 con 0x555be75cdde0 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555be7507950 con 0x555be75a12c0 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36018/0 (socket says 172.21.15.114:36018) 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/2977890825 learned_addr learned my addr 172.21.15.114:0/2977890825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75cdde0 0x555be75a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b877fe640 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75a12c0 0x555be75d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75a12c0 msgr2=0x555be75d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75a12c0 0x555be75d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75cdde0 msgr2=0x555be75a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75cdde0 0x555be75a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/2977890825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be721e2d0 con 0x555be75ce1c0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75cdde0 0x555be75a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.515+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75d0b70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b700054c0 tx=0x7f2b70010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354b367ee4a177ad server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b7d7fa640 1 -- 172.21.15.114:0/2977890825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000d6a0 con 0x555be75ce1c0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b7d7fa640 1 -- 172.21.15.114:0/2977890825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7000d840 con 0x555be75ce1c0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b7d7fa640 1 -- 172.21.15.114:0/2977890825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000dc10 con 0x555be75ce1c0 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 -- 172.21.15.114:0/2977890825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 msgr2=0x555be75d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75d0b70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b700054c0 tx=0x7f2b70010000 comp rx=0 tx=0).stop 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 -- 172.21.15.114:0/2977890825 shutdown_connections 2024-04-13T02:44:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75a12c0 0x555be75d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75d0b70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 --2- 172.21.15.114:0/2977890825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75cdde0 0x555be75a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 -- 172.21.15.114:0/2977890825 >> 172.21.15.114:0/2977890825 conn(0x555be75a2ff0 msgr2=0x555be75ebb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 -- 172.21.15.114:0/2977890825 shutdown_connections 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.516+0000 7f2b90652740 1 -- 172.21.15.114:0/2977890825 wait complete. 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.517+0000 7f2b90652740 1 -- start start 2024-04-13T02:44:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.517+0000 7f2b90652740 1 Processor -- start 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 0x555be75c2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75ce1c0 0x555be75e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e66e0 0x555be75d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x555be75a5590 con 0x555be75cdde0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555be74c59e0 con 0x555be75e66e0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555be75a4980 con 0x555be75ce1c0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 10 client.0 _ll_register_callbacks cb 0x555be7501220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 0x555be75c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 0x555be75c2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36030/0 (socket says 172.21.15.114:36030) 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 -- 172.21.15.114:0/3810812095 learned_addr learned my addr 172.21.15.114:0/3810812095 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75ce1c0 0x555be75e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b877fe640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e66e0 0x555be75d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 -- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75ce1c0 msgr2=0x555be75e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75ce1c0 0x555be75e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 -- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e66e0 msgr2=0x555be75d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e66e0 0x555be75d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 -- 172.21.15.114:0/3810812095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be72e86b0 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 0x555be75c2550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2b7807b980 tx=0x7f2b7807b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be53d5cdeabb8be server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b667fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b667fc640 1 -- 172.21.15.114:0/3810812095 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78084140 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b667fc640 1 -- 172.21.15.114:0/3810812095 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b780842e0 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b7000d840 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b667fc640 1 -- 172.21.15.114:0/3810812095 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2b780041d0 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 10 client.4677 fetch_fsmap learned FSMap version 6 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.518+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x555be75bfa60 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b667fc640 1 -- 172.21.15.114:0/3810812095 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7000d840 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b667fc640 1 -- 172.21.15.114:0/3810812095 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f2b7807ae40 con 0x555be75cdde0 2024-04-13T02:44:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b90652740 10 client.4677 fetch_fsmap finished waiting for FSMap version 6 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b90652740 10 client.4677 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b90652740 20 client.4677 populate_metadata read hostname 'smithi114' 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b90652740 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e4f60 0x555be7609c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b90652740 4 client.4677 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 --> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555be75193b0 con 0x555be75e4f60 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e4f60 0x555be7609c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b667fc640 10 client.4677 ms_handle_connect on v2:172.21.15.130:6833/3235541552 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.519+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e4f60 0x555be7609c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=132414deff1c7abf server_cookie=b6ff1520ed8ec770 in_seq=0 out_seq=0 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b667fc640 1 -- 172.21.15.114:0/3810812095 <== mds.0 v2:172.21.15.130:6833/3235541552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555be75193b0 con 0x555be75e4f60 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b667fc640 10 client.4677 handle_command_reply: tid=0 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 client.4677 shutdown 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 msgr2=0x555be75c2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 0x555be75c2550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2b7807b980 tx=0x7f2b7807b9f0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 shutdown_connections 2024-04-13T02:44:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e4f60 0x555be7609c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e66e0 0x555be75d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b667fc640 0 client.4677 ms_handle_reset on v2:172.21.15.130:6833/3235541552 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75ce1c0 0x555be75e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 --2- 172.21.15.114:0/3810812095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75cdde0 0x555be75c2550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 >> 172.21.15.114:0/3810812095 conn(0x555be75a12c0 msgr2=0x555be75ef080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 shutdown_connections 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 1 -- 172.21.15.114:0/3810812095 wait complete. 2024-04-13T02:44:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.520+0000 7f2b90652740 20 client.4677 trim_cache size 0 max 16384 2024-04-13T02:44:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.538+0000 7f2b90652740 1 Processor -- start 2024-04-13T02:44:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.538+0000 7f2b90652740 1 -- start start 2024-04-13T02:44:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b90652740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e4f60 0x555be75a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b90652740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880ca6b0 con 0x555be75ce1c0 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880c9a10 con 0x555be75e4f60 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2b880ca060 con 0x555be75cdde0 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36046/0 (socket says 172.21.15.114:36046) 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/1241175373 learned_addr learned my addr 172.21.15.114:0/1241175373 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b877fe640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e4f60 0x555be75a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 msgr2=0x555be75a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e4f60 msgr2=0x555be75a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e4f60 0x555be75a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 -- 172.21.15.114:0/1241175373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be75a2750 con 0x555be75ce1c0 2024-04-13T02:44:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b877fe640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e4f60 0x555be75a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.539+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75a5a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001e000 tx=0x7f2b70019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1648c8e1b010461 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b7cff9640 1 -- 172.21.15.114:0/1241175373 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70036070 con 0x555be75ce1c0 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b7cff9640 1 -- 172.21.15.114:0/1241175373 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7000d820 con 0x555be75ce1c0 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b7cff9640 1 -- 172.21.15.114:0/1241175373 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70026040 con 0x555be75ce1c0 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 -- 172.21.15.114:0/1241175373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 msgr2=0x555be75a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75a5a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001e000 tx=0x7f2b70019070 comp rx=0 tx=0).stop 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 -- 172.21.15.114:0/1241175373 shutdown_connections 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75e4f60 0x555be75a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75ce1c0 0x555be75a5a80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 --2- 172.21.15.114:0/1241175373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 -- 172.21.15.114:0/1241175373 >> 172.21.15.114:0/1241175373 conn(0x555be75a12c0 msgr2=0x555be75a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 -- 172.21.15.114:0/1241175373 shutdown_connections 2024-04-13T02:44:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.540+0000 7f2b90652740 1 -- 172.21.15.114:0/1241175373 wait complete. 2024-04-13T02:44:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 -- start start 2024-04-13T02:44:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 Processor -- start 2024-04-13T02:44:52.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75ce1c0 0x555be765a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 0x555be765cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x555be75e4de0 con 0x555be75e4f60 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555be75e3390 con 0x555be75ce1c0 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555be75e53a0 con 0x555be75cdde0 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.541+0000 7f2b90652740 10 client.0 _ll_register_callbacks cb 0x7f2b78077c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 0x555be765cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 0x555be765cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36062/0 (socket says 172.21.15.114:36062) 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 -- 172.21.15.114:0/81026787 learned_addr learned my addr 172.21.15.114:0/81026787 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b7e7fc640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75ce1c0 0x555be765a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 -- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 msgr2=0x555be75ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 -- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75ce1c0 msgr2=0x555be765a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75ce1c0 0x555be765a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 -- 172.21.15.114:0/81026787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be7604b90 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b877fe640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 0x555be765cb90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b80000f80 tx=0x7f2b80001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ec2294cdf7a6ea server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b667fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b667fc640 1 -- 172.21.15.114:0/81026787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80007a70 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b667fc640 1 -- 172.21.15.114:0/81026787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b80016680 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b7000d820 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b667fc640 1 -- 172.21.15.114:0/81026787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2b80023050 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b90652740 10 client.4683 fetch_fsmap learned FSMap version 6 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x555be765f050 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b667fc640 1 -- 172.21.15.114:0/81026787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7000d820 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.542+0000 7f2b667fc640 1 -- 172.21.15.114:0/81026787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f2b80026020 con 0x555be75e4f60 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 10 client.4683 fetch_fsmap finished waiting for FSMap version 6 2024-04-13T02:44:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 10 client.4683 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 20 client.4683 populate_metadata read hostname 'smithi114' 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e66e0 0x555be75e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 4 client.4683 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 --> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] -- command(tid 0: {"prefix": "status"}) -- 0x555be7513220 con 0x555be75e66e0 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e66e0 0x555be75e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b667fc640 10 client.4683 ms_handle_connect on v2:172.21.15.130:6833/3235541552 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b86ffd640 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e66e0 0x555be75e6ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56c8d51fdb59d95 server_cookie=8826b002a7427f6c in_seq=0 out_seq=0 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b667fc640 1 -- 172.21.15.114:0/81026787 <== mds.0 v2:172.21.15.130:6833/3235541552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555be7513220 con 0x555be75e66e0 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b667fc640 10 client.4683 handle_command_reply: tid=0 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 client.4683 shutdown 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 msgr2=0x555be765cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 0x555be765cb90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b80000f80 tx=0x7f2b80001a70 comp rx=0 tx=0).stop 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 shutdown_connections 2024-04-13T02:44:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555be75e4f60 0x555be765cb90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:6833/3235541552,v1:172.21.15.130:6835/3235541552] conn(0x555be75e66e0 0x555be75e6ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555be75ce1c0 0x555be765a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 --2- 172.21.15.114:0/81026787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555be75cdde0 0x555be75ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b667fc640 0 client.4683 ms_handle_reset on v2:172.21.15.130:6833/3235541552 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.543+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 >> 172.21.15.114:0/81026787 conn(0x555be75a12c0 msgr2=0x555be7604110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 shutdown_connections 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b90652740 1 -- 172.21.15.114:0/81026787 wait complete. 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b90652740 20 client.4683 trim_cache size 0 max 16384 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "202cca92-4b79-424a-b5f1-59b181ba42ec", 2024-04-13T02:44:52.551 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4288, 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 12.325066699000001, 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 6, 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 20, 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 20, 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 19.438878032000002 2024-04-13T02:44:52.552 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2b6806c920 msgr2=0x7f2b6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2b6806c920 0x7f2b6806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2b880b35b0 tx=0x7f2b70009040 comp rx=0 tx=0).stop 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 msgr2=0x7f2b880cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 0x7f2b880cf240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b780090b0 tx=0x7f2b780046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 shutdown_connections 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b88161fc0 0x7f2b88153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2b6806c920 0x7f2b6806ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2b880d48a0 0x7f2b880cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 --2- 172.21.15.114:0/367238726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b880cf9b0 0x7f2b880cf240 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 >> 172.21.15.114:0/367238726 conn(0x7f2b88073480 msgr2=0x7f2b880b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 shutdown_connections 2024-04-13T02:44:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:52.544+0000 7f2b8d860640 1 -- 172.21.15.114:0/367238726 wait complete. 2024-04-13T02:44:52.555 INFO:teuthology.run_tasks:Running task sequential... 2024-04-13T02:44:52.567 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-13T02:44:52.567 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-13T02:44:52.567 INFO:teuthology.task.print:Enabling mgr modules 2024-04-13T02:44:52.567 INFO:teuthology.run_tasks:Running task kclient... 2024-04-13T02:44:52.593 INFO:tasks.kclient:Mounting kernel clients... 2024-04-13T02:44:52.593 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-13T02:44:52.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.593 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:44:52.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-13T02:44:52.677 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-13T02:44:52.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:44:52.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.682 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:44:52.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-13T02:44:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-13T02:44:52.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:44:52.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.803 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-13T02:44:52.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.822 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-13T02:44:52.895 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-04-13T02:44:52.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:44:52.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.897 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-13T02:44:52.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:52.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-13T02:44:53.024 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-04-13T02:44:53.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:44:53.026 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-13T02:44:53.027 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-13T02:44:53.027 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-13T02:44:53.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.127+0000 7fd63af1e640 1 Processor -- start 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.127+0000 7fd63af1e640 1 -- start start 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd63af1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6340b3ec0 0x7fd6340cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd63af1e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63406cd90 con 0x7fd63409b2a0 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd63af1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63406d070 con 0x7fd63415edb0 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd63af1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd6340cce20 con 0x7fd6340b3ec0 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd633fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd63409b2a0 0x7fd6340cd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38092/0 (socket says 172.21.15.114:38092) 2024-04-13T02:44:53.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd633fff640 1 -- 172.21.15.114:0/2164482149 learned_addr learned my addr 172.21.15.114:0/2164482149 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6394bb640 1 --2- 172.21.15.114:0/2164482149 >> v2:172.21.15.130:3300/0 conn(0x7fd6340b3ec0 0x7fd6340cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6337fe640 1 -- 172.21.15.114:0/2164482149 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411809575 0 0) 0x7fd63406cd90 con 0x7fd63409b2a0 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6337fe640 1 -- 172.21.15.114:0/2164482149 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd624003520 con 0x7fd63409b2a0 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6337fe640 1 -- 172.21.15.114:0/2164482149 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1455645002 0 0) 0x7fd624003520 con 0x7fd63409b2a0 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6394bb640 1 -- 172.21.15.114:0/2164482149 >> v1:172.21.15.130:6789/0 conn(0x7fd63415edb0 legacy=0x7fd63409ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6394bb640 1 -- 172.21.15.114:0/2164482149 >> v1:172.21.15.114:6789/0 conn(0x7fd63409b2a0 legacy=0x7fd6340cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.128+0000 7fd6394bb640 1 -- 172.21.15.114:0/2164482149 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6340cd070 con 0x7fd6340b3ec0 2024-04-13T02:44:53.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.129+0000 7fd6394bb640 1 --2- 172.21.15.114:0/2164482149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6340b3ec0 0x7fd6340cdf60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6340ccfa0 tx=0x7fd62c02bc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd8c6850e42208c server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.129+0000 7fd6337fe640 1 -- 172.21.15.114:0/2164482149 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c039070 con 0x7fd6340b3ec0 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.129+0000 7fd6337fe640 1 -- 172.21.15.114:0/2164482149 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c02c790 con 0x7fd6340b3ec0 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.129+0000 7fd6337fe640 1 -- 172.21.15.114:0/2164482149 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620001670 con 0x7fd6340b3ec0 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 -- 172.21.15.114:0/2164482149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6340b3ec0 msgr2=0x7fd6340cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2164482149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6340b3ec0 0x7fd6340cdf60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6340ccfa0 tx=0x7fd62c02bc60 comp rx=0 tx=0).stop 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 -- 172.21.15.114:0/2164482149 shutdown_connections 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2164482149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6340b3ec0 0x7fd6340cdf60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 -- 172.21.15.114:0/2164482149 >> 172.21.15.114:0/2164482149 conn(0x7fd6340d27d0 msgr2=0x7fd6340d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 -- 172.21.15.114:0/2164482149 shutdown_connections 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.130+0000 7fd63af1e640 1 -- 172.21.15.114:0/2164482149 wait complete. 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.131+0000 7fd63af1e640 1 Processor -- start 2024-04-13T02:44:53.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.131+0000 7fd63af1e640 1 -- start start 2024-04-13T02:44:53.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd63409b2a0 0x7fd634158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:53.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 0x7fd6341596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:53.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd63415edb0 0x7fd634150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:53.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd63406d450 con 0x7fd6340b3ec0 2024-04-13T02:44:53.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd63406ca40 con 0x7fd63415edb0 2024-04-13T02:44:53.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd63406d5d0 con 0x7fd63409b2a0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 0x7fd6341596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 0x7fd6341596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36070/0 (socket says 172.21.15.114:36070) 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 -- 172.21.15.114:0/2622753072 learned_addr learned my addr 172.21.15.114:0/2622753072 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd6394bb640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd63415edb0 0x7fd634150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd638cba640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd63409b2a0 0x7fd634158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 -- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd63409b2a0 msgr2=0x7fd634158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd63409b2a0 0x7fd634158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 -- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd63415edb0 msgr2=0x7fd634150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd63415edb0 0x7fd634150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 -- 172.21.15.114:0/2622753072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd634158610 con 0x7fd6340b3ec0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd633fff640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 0x7fd6341596b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c500 tx=0x7fd62000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620017070 con 0x7fd6340b3ec0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd620005cc0 con 0x7fd6340b3ec0 2024-04-13T02:44:53.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6341588f0 con 0x7fd6340b3ec0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620007330 con 0x7fd6340b3ec0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.132+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd634158eb0 con 0x7fd6340b3ec0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.133+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd634068c80 con 0x7fd6340b3ec0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.134+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd62001a070 con 0x7fd6340b3ec0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.134+0000 7fd6317fa640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd61806c920 0x7fd61806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.134+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd62008aed0 con 0x7fd6340b3ec0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.134+0000 7fd638cba640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd61806c920 0x7fd61806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:53.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.135+0000 7fd638cba640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd61806c920 0x7fd61806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd628000f60 tx=0x7fd628009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:53.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.139+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd620058cc0 con 0x7fd6340b3ec0 2024-04-13T02:44:53.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.351+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd63415e610 con 0x7fd6340b3ec0 2024-04-13T02:44:53.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.351+0000 7fd6317fa640 1 -- 172.21.15.114:0/2622753072 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fd62005cfc0 con 0x7fd6340b3ec0 2024-04-13T02:44:53.352 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd61806c920 msgr2=0x7fd61806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd61806c920 0x7fd61806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd628000f60 tx=0x7fd628009040 comp rx=0 tx=0).stop 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 msgr2=0x7fd6341596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 0x7fd6341596b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c500 tx=0x7fd62000c9c0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 shutdown_connections 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd63415edb0 0x7fd634150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340b3ec0 0x7fd6341596b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd61806c920 0x7fd61806ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 --2- 172.21.15.114:0/2622753072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd63409b2a0 0x7fd634158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:53.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 >> 172.21.15.114:0/2622753072 conn(0x7fd6340d27d0 msgr2=0x7fd63409ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:53.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 shutdown_connections 2024-04-13T02:44:53.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53.353+0000 7fd63af1e640 1 -- 172.21.15.114:0/2622753072 wait complete. 2024-04-13T02:44:53.364 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T02:44:53.365 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-13T02:44:53.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:53.365 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-13T02:44:53.381 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:53.381 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:53.381 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:53.381 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T02:44:53.382 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:53.383 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T02:44:53.383 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-04-13T02:44:53.383 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-04-13T02:44:53.383 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:53.383 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-13T02:44:53.384 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:53.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:53.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:53.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:53.578 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T02:44:53.605 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-13T02:44:53.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:53.606 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-13T02:44:53.675 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-13T02:44:53.675 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T02:44:53.675 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T02:44:53.675 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T02:44:53.675 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T02:44:53.676 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:53.676 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:53.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T02:44:53.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T02:44:53.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T02:44:53.676 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:54.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:54.011 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:44:54.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:54.025 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-04-13T02:44:54.081 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:54.081 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:54.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-13T02:44:54.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-13T02:44:54.081 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:54.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:54.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:54.204 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-13T02:44:54.204 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:54.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:54.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:54.350 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:54.350 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:54.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-13T02:44:54.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-04-13T02:44:54.350 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:54.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:54.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:44:54.431 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-13T02:44:54.445 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-13T02:44:54.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:44:54.445 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-13T02:44:54.500 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-13T02:44:54.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:54.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:44:54.584 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:44:54.584 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-13T02:44:54.584 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:44:54.688 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:44:54.688 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-13T02:44:54.688 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:44:54.688 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:44:54.688 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-13T02:44:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=202cca92-4b79-424a-b5f1-59b181ba42ec" will pass to kernel 2024-04-13T02:44:54.695 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-13T02:44:54.695 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-13T02:44:54.695 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-13T02:44:54.695 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-13T02:44:54.696 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-13T02:44:54.697 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-13T02:44:54.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:54.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-13T02:44:54.725 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:54.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:54.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:54.827 INFO:teuthology.orchestra.run.smithi114.stdout:client4451 2024-04-13T02:44:54.827 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:54.827 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:44:54.843 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:54.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:54.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:54.945 INFO:teuthology.orchestra.run.smithi114.stdout:client4451 2024-04-13T02:44:54.945 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:54.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:55.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:55.006 INFO:teuthology.orchestra.run.smithi114.stdout:client4451 2024-04-13T02:44:55.007 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/202cca92-4b79-424a-b5f1-59b181ba42ec.client4451/status') 2024-04-13T02:44:55.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4451 (3)172.21.15.114:0/2661379234 2024-04-13T02:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-04-13T02:44:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-04-13T02:44:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-04-13T02:44:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:71 bytes copied, 2.0393e-05 s, 3.5 MB/s 2024-04-13T02:44:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:55.079 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-13T02:44:55.079 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-13T02:44:55.080 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-13T02:44:55.080 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-13T02:44:55.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 Processor -- start 2024-04-13T02:44:55.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 -- start start 2024-04-13T02:44:55.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1552e0 0x7fe1dc0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1dc15c170 0x7fe1dc072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe1dc1556c0 0x7fe1dc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe1dc0b38d0 con 0x7fe1dc15c170 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe1dc0b48e0 con 0x7fe1dc1556c0 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.179+0000 7fe1e2877640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe1dc0b3b20 con 0x7fe1dc1552e0 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1dc15c170 0x7fe1dc072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1dc15c170 0x7fe1dc072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36076/0 (socket says 172.21.15.114:36076) 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 -- 172.21.15.114:0/464772800 learned_addr learned my addr 172.21.15.114:0/464772800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1e0e14640 1 --2- 172.21.15.114:0/464772800 >> v2:172.21.15.130:3300/0 conn(0x7fe1dc1556c0 0x7fe1dc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 -- 172.21.15.114:0/464772800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1552e0 msgr2=0x7fe1dc0afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1dbfff640 1 --2- 172.21.15.114:0/464772800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1552e0 0x7fe1dc0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 --2- 172.21.15.114:0/464772800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1552e0 0x7fe1dc0afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 -- 172.21.15.114:0/464772800 >> v2:172.21.15.130:3300/0 conn(0x7fe1dc1556c0 msgr2=0x7fe1dc072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 --2- 172.21.15.114:0/464772800 >> v2:172.21.15.130:3300/0 conn(0x7fe1dc1556c0 0x7fe1dc072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.180+0000 7fe1db7fe640 1 -- 172.21.15.114:0/464772800 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc0b3e00 con 0x7fe1dc15c170 2024-04-13T02:44:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1db7fe640 1 --2- 172.21.15.114:0/464772800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc072a70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc06ff10 tx=0x7fe1d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f9917731944683 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1daffd640 1 -- 172.21.15.114:0/464772800 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0035020 con 0x7fe1dc15c170 2024-04-13T02:44:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1daffd640 1 -- 172.21.15.114:0/464772800 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d0031870 con 0x7fe1dc15c170 2024-04-13T02:44:55.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1daffd640 1 -- 172.21.15.114:0/464772800 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0031c40 con 0x7fe1dc15c170 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 -- 172.21.15.114:0/464772800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 msgr2=0x7fe1dc072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 --2- 172.21.15.114:0/464772800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc072a70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc06ff10 tx=0x7fe1d002b910 comp rx=0 tx=0).stop 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 -- 172.21.15.114:0/464772800 shutdown_connections 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 --2- 172.21.15.114:0/464772800 >> v2:172.21.15.130:3300/0 conn(0x7fe1dc1556c0 0x7fe1dc072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 --2- 172.21.15.114:0/464772800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc072a70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 --2- 172.21.15.114:0/464772800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1552e0 0x7fe1dc0afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 -- 172.21.15.114:0/464772800 >> 172.21.15.114:0/464772800 conn(0x7fe1dc0b27b0 msgr2=0x7fe1dc0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 -- 172.21.15.114:0/464772800 shutdown_connections 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.181+0000 7fe1e2877640 1 -- 172.21.15.114:0/464772800 wait complete. 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 Processor -- start 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 -- start start 2024-04-13T02:44:55.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1dc1552e0 0x7fe1dc148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1556c0 0x7fe1dc0a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0d0110 con 0x7fe1dc15c170 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0b43c0 con 0x7fe1dc1552e0 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.183+0000 7fe1e2877640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe1dc0b00a0 con 0x7fe1dc1556c0 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36088/0 (socket says 172.21.15.114:36088) 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 -- 172.21.15.114:0/3201983684 learned_addr learned my addr 172.21.15.114:0/3201983684 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1dbfff640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1dc1552e0 0x7fe1dc148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 -- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1556c0 msgr2=0x7fe1dc0a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1db7fe640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1556c0 0x7fe1dc0a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1556c0 0x7fe1dc0a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 -- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1dc1552e0 msgr2=0x7fe1dc148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1dc1552e0 0x7fe1dc148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 -- 172.21.15.114:0/3201983684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc1486c0 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1dbfff640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1dc1552e0 0x7fe1dc148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e0e14640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc1596f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400cd70 tx=0x7fe1d400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400ed40 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d4003990 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc0a9da0 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4003b60 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.184+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc0aa360 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.185+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc068c80 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.185+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1d401c020 con 0x7fe1dc15c170 2024-04-13T02:44:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.186+0000 7fe1d8ff9640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1c806c8f0 0x7fe1c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:55.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.186+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d408dde0 con 0x7fe1dc15c170 2024-04-13T02:44:55.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.186+0000 7fe1dbfff640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1c806c8f0 0x7fe1c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:55.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.186+0000 7fe1dbfff640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1c806c8f0 0x7fe1c806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00b800 tx=0x7fe1cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:55.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.190+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1dc1486c0 con 0x7fe1dc15c170 2024-04-13T02:44:55.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.407+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe1dc0b1500 con 0x7fe1dc15c170 2024-04-13T02:44:55.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.407+0000 7fe1d8ff9640 1 -- 172.21.15.114:0/3201983684 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fe1d405c200 con 0x7fe1dc15c170 2024-04-13T02:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-13T02:44:55.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1c806c8f0 msgr2=0x7fe1c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:55.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1c806c8f0 0x7fe1c806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00b800 tx=0x7fe1cc008040 comp rx=0 tx=0).stop 2024-04-13T02:44:55.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 msgr2=0x7fe1dc1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:55.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc1596f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400cd70 tx=0x7fe1d400e420 comp rx=0 tx=0).stop 2024-04-13T02:44:55.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 shutdown_connections 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1dc15c170 0x7fe1dc1596f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1c806c8f0 0x7fe1c806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe1dc1556c0 0x7fe1dc0a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 --2- 172.21.15.114:0/3201983684 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1dc1552e0 0x7fe1dc148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 >> 172.21.15.114:0/3201983684 conn(0x7fe1dc0b27b0 msgr2=0x7fe1dc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 shutdown_connections 2024-04-13T02:44:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55.409+0000 7fe1e2877640 1 -- 172.21.15.114:0/3201983684 wait complete. 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T02:44:55.421 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-13T02:44:55.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.421 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-13T02:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T02:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42742sec preferred_lft 42742sec 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 72:7f:c9:31:94:8c brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::301c:13ff:fea6:db75/64 scope link tentative 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 72:7f:c9:31:94:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::707f:c9ff:fe31:948c/64 scope link tentative 2024-04-13T02:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.439 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T02:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-13T02:44:55.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.504 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-13T02:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-13T02:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T02:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T02:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T02:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T02:44:55.559 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:55.559 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:55.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T02:44:55.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T02:44:55.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T02:44:55.560 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:55.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:55.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:55.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.695 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-13T02:44:55.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.710 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-04-13T02:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-13T02:44:55.764 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:55.764 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:55.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-13T02:44:55.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-13T02:44:55.765 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:55.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:55.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether fe:e9:a0:11:18:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-13T02:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-13T02:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::fce9:a0ff:fe11:18ad/64 scope link 2024-04-13T02:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:55.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether fe:e9:a0:11:18:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::fce9:a0ff:fe11:18ad/64 scope link 2024-04-13T02:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:55.985 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-13T02:44:55.985 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:56.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:56.151 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:56.151 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:44:56.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2024-04-13T02:44:56.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2024-04-13T02:44:56.151 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:44:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:56.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:56.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:44:56.235 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-13T02:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-13T02:44:56.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:44:56.249 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-13T02:44:56.304 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-13T02:44:56.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:56.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-13T02:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-13T02:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-13T02:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-13T02:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-13T02:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-13T02:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-13T02:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=202cca92-4b79-424a-b5f1-59b181ba42ec" will pass to kernel 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-13T02:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-13T02:44:56.418 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-13T02:44:56.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:56.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-13T02:44:56.484 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:56.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:client4454 2024-04-13T02:44:56.580 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:44:56.580 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:44:56.596 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:56.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:56.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:client4454 2024-04-13T02:44:56.692 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:56.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:client4454 2024-04-13T02:44:56.747 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/202cca92-4b79-424a-b5f1-59b181ba42ec.client4454/status') 2024-04-13T02:44:56.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4454 (3)172.21.15.114:0/12342989 2024-04-13T02:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-04-13T02:44:56.808 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-04-13T02:44:56.809 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-04-13T02:44:56.809 INFO:teuthology.orchestra.run.smithi114.stderr:69 bytes copied, 2.103e-05 s, 3.3 MB/s 2024-04-13T02:44:56.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:56.815 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-13T02:44:56.815 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-13T02:44:56.815 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-13T02:44:56.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-13T02:44:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.915+0000 7f827e7b4640 1 Processor -- start 2024-04-13T02:44:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.915+0000 7f827e7b4640 1 -- start start 2024-04-13T02:44:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827e7b4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f827815b6d0 0x7f82780cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827e7b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8278070210 0x7f82780b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827e7b4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827806f940 con 0x7f82780ce250 2024-04-13T02:44:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827e7b4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f827806e8a0 con 0x7f827815b6d0 2024-04-13T02:44:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827e7b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f827806eb80 con 0x7f8278070210 2024-04-13T02:44:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f8277fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f827815b6d0 0x7f82780cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827cd51640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f82780ce250 0x7f82780721e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38102/0 (socket says 172.21.15.114:38102) 2024-04-13T02:44:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f827cd51640 1 -- 172.21.15.114:0/156470327 learned_addr learned my addr 172.21.15.114:0/156470327 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f82777fe640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8278070210 0x7f82780b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f8277fff640 1 -- 172.21.15.114:0/156470327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8278070210 msgr2=0x7f82780b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f8277fff640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8278070210 0x7f82780b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f8277fff640 1 -- 172.21.15.114:0/156470327 >> v1:172.21.15.114:6789/0 conn(0x7f82780ce250 legacy=0x7f82780721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f8277fff640 1 -- 172.21.15.114:0/156470327 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827806ee60 con 0x7f827815b6d0 2024-04-13T02:44:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f8276ffd640 1 -- 172.21.15.114:0/156470327 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250442252 0 0) 0x7f827806f940 con 0x7f82780ce250 2024-04-13T02:44:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.916+0000 7f82777fe640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8278070210 0x7f82780b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:44:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.917+0000 7f8277fff640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f827815b6d0 0x7f82780cdd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f826c0097a0 tx=0x7f826c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88265162f6bb86d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.917+0000 7f8276ffd640 1 -- 172.21.15.114:0/156470327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c0315a0 con 0x7f827815b6d0 2024-04-13T02:44:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.917+0000 7f8276ffd640 1 -- 172.21.15.114:0/156470327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c037070 con 0x7f827815b6d0 2024-04-13T02:44:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.917+0000 7f8276ffd640 1 -- 172.21.15.114:0/156470327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c031960 con 0x7f827815b6d0 2024-04-13T02:44:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 -- 172.21.15.114:0/156470327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f827815b6d0 msgr2=0x7f82780cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f827815b6d0 0x7f82780cdd10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f826c0097a0 tx=0x7f826c02b840 comp rx=0 tx=0).stop 2024-04-13T02:44:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 -- 172.21.15.114:0/156470327 shutdown_connections 2024-04-13T02:44:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8278070210 0x7f82780b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 --2- 172.21.15.114:0/156470327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f827815b6d0 0x7f82780cdd10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 -- 172.21.15.114:0/156470327 >> 172.21.15.114:0/156470327 conn(0x7f82780b27b0 msgr2=0x7f82780b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 -- 172.21.15.114:0/156470327 shutdown_connections 2024-04-13T02:44:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.918+0000 7f827e7b4640 1 -- 172.21.15.114:0/156470327 wait complete. 2024-04-13T02:44:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.919+0000 7f827e7b4640 1 Processor -- start 2024-04-13T02:44:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.919+0000 7f827e7b4640 1 -- start start 2024-04-13T02:44:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827e7b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 0x7f8278149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827e7b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82780ce250 0x7f8278143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827e7b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f827815b6d0 0x7f82780b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827e7b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f827815cac0 con 0x7f8278070210 2024-04-13T02:44:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827e7b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f827806f420 con 0x7f82780ce250 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827e7b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f827815cc40 con 0x7f827815b6d0 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 0x7f8278149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 0x7f8278149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36108/0 (socket says 172.21.15.114:36108) 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 -- 172.21.15.114:0/576218615 learned_addr learned my addr 172.21.15.114:0/576218615 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f827cd51640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f827815b6d0 0x7f82780b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 -- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f827815b6d0 msgr2=0x7f82780b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f827815b6d0 0x7f82780b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 -- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82780ce250 msgr2=0x7f8278143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82780ce250 0x7f8278143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 -- 172.21.15.114:0/576218615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8278145ab0 con 0x7f8278070210 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8277fff640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 0x7f8278149cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f826c0097a0 tx=0x7f826c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.920+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c004230 con 0x7f8278070210 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.921+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c0043f0 con 0x7f8278070210 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.921+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c032880 con 0x7f8278070210 2024-04-13T02:44:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.921+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8278145df0 con 0x7f8278070210 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.921+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8278146090 con 0x7f8278070210 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.921+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8278068c80 con 0x7f8278070210 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.922+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f826c032a20 con 0x7f8278070210 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.922+0000 7f8274ff9640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f826406c8f0 0x7f826406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.922+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f826c02f030 con 0x7f8278070210 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.922+0000 7f82777fe640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f826406c8f0 0x7f826406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.923+0000 7f82777fe640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f826406c8f0 0x7f826406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8268006fd0 tx=0x7f8268008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:56.927+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f826c041070 con 0x7f8278070210 2024-04-13T02:44:57.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.138+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8278146260 con 0x7f8278070210 2024-04-13T02:44:57.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.138+0000 7f8274ff9640 1 -- 172.21.15.114:0/576218615 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f826c07c050 con 0x7f8278070210 2024-04-13T02:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-13T02:44:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f826406c8f0 msgr2=0x7f826406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f826406c8f0 0x7f826406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8268006fd0 tx=0x7f8268008040 comp rx=0 tx=0).stop 2024-04-13T02:44:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 msgr2=0x7f8278149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 0x7f8278149cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f826c0097a0 tx=0x7f826c0046c0 comp rx=0 tx=0).stop 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 shutdown_connections 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f826406c8f0 0x7f826406edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f827815b6d0 0x7f82780b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82780ce250 0x7f8278143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 --2- 172.21.15.114:0/576218615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278070210 0x7f8278149cc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.140+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 >> 172.21.15.114:0/576218615 conn(0x7f82780b27b0 msgr2=0x7f827814f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.141+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 shutdown_connections 2024-04-13T02:44:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:57.141+0000 7f827e7b4640 1 -- 172.21.15.114:0/576218615 wait complete. 2024-04-13T02:44:57.152 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-13T02:44:57.152 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T02:44:57.152 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2024-04-13T02:44:57.152 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-13T02:44:57.152 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-13T02:44:57.152 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-13T02:44:57.153 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-13T02:44:57.153 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T02:44:57.153 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-13T02:44:57.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:57.153 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2024-04-13T02:44:57.172 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42724sec preferred_lft 42724sec 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2024-04-13T02:44:57.173 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:57.174 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-13T02:44:57.174 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:57.174 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:57.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2024-04-13T02:44:57.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2024-04-13T02:44:57.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2024-04-13T02:44:57.174 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-13T02:44:57.178 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:57.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:57.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:57.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:57.387 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T02:44:57.415 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-13T02:44:57.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:57.416 DEBUG:teuthology.orchestra.run.smithi130:> route 2024-04-13T02:44:57.488 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2024-04-13T02:44:57.488 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T02:44:57.488 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T02:44:57.488 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T02:44:57.488 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T02:44:57.488 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:57.489 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:57.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T02:44:57.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T02:44:57.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T02:44:57.489 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:57.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:57.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:57.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:57.798 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-13T02:44:57.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:57.817 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2024-04-13T02:44:57.872 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:57.872 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:57.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-13T02:44:57.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-13T02:44:57.872 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:57.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:57.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:57.996 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-13T02:44:57.997 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:58.046 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:58.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:58.138 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:58.138 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:58.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2024-04-13T02:44:58.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2024-04-13T02:44:58.138 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:58.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:58.214 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:58.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:44:58.221 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-13T02:44:58.248 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-13T02:44:58.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:44:58.248 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-13T02:44:58.303 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-13T02:44:58.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:58.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-13T02:44:58.388 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-13T02:44:58.388 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-13T02:44:58.388 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:44:58.509 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-13T02:44:58.509 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-13T02:44:58.509 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-13T02:44:58.510 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:44:58.510 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:44:58.510 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-13T02:44:58.510 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-13T02:44:58.510 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=202cca92-4b79-424a-b5f1-59b181ba42ec" will pass to kernel 2024-04-13T02:44:58.511 INFO:teuthology.orchestra.run.smithi130.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-13T02:44:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: You just mounted a file system that supports labels which does not 2024-04-13T02:44:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-13T02:44:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: applications will generate AVC messages and not be allowed access to 2024-04-13T02:44:58.511 INFO:teuthology.orchestra.run.smithi130.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-13T02:44:58.512 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-13T02:44:58.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:58.513 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-13T02:44:58.545 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:58.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:58.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:58.641 INFO:teuthology.orchestra.run.smithi130.stdout:client4594 2024-04-13T02:44:58.641 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:44:58.641 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:44:58.657 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:58.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:58.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:58.751 INFO:teuthology.orchestra.run.smithi130.stdout:client4594 2024-04-13T02:44:58.752 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:44:58.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:44:58.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:58.806 INFO:teuthology.orchestra.run.smithi130.stdout:client4594 2024-04-13T02:44:58.807 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/202cca92-4b79-424a-b5f1-59b181ba42ec.client4594/status') 2024-04-13T02:44:58.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:58.878 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4594 (3)192.168.0.1:0/1970502437 2024-04-13T02:44:58.878 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2024-04-13T02:44:58.878 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2024-04-13T02:44:58.878 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2024-04-13T02:44:58.879 INFO:teuthology.orchestra.run.smithi130.stderr:69 bytes copied, 2.4041e-05 s, 2.9 MB/s 2024-04-13T02:44:58.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:58.885 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-13T02:44:58.886 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-13T02:44:58.886 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-13T02:44:58.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-13T02:44:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.997+0000 7fbb72680640 1 Processor -- start 2024-04-13T02:44:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.997+0000 7fbb72680640 1 -- start start 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb72680640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c1481f0 0x7fbb6c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb72680640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb6c0affc0 0x7fbb6c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb72680640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6c1485d0 con 0x7fbb6c0b5560 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb72680640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6c15ffc0 con 0x7fbb6c0affc0 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb72680640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6c0aef20 con 0x7fbb6c1481f0 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb6b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb6c0affc0 0x7fbb6c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb70c1d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb6c0b5560 0x7fbb6c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38756/0 (socket says 172.21.15.114:38756) 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb70c1d640 1 -- 172.21.15.114:0/4103895715 learned_addr learned my addr 172.21.15.114:0/4103895715 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb6b7fe640 1 -- 172.21.15.114:0/4103895715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c1481f0 msgr2=0x7fbb6c15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:44:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb6b7fe640 1 --2- 172.21.15.114:0/4103895715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c1481f0 0x7fbb6c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb6b7fe640 1 -- 172.21.15.114:0/4103895715 >> v1:172.21.15.114:6789/0 conn(0x7fbb6c0b5560 legacy=0x7fbb6c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb6b7fe640 1 -- 172.21.15.114:0/4103895715 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c0af200 con 0x7fbb6c0affc0 2024-04-13T02:44:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.998+0000 7fbb6affd640 1 -- 172.21.15.114:0/4103895715 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935626005 0 0) 0x7fbb6c1485d0 con 0x7fbb6c0b5560 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.999+0000 7fbb6b7fe640 1 --2- 172.21.15.114:0/4103895715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c0affc0 0x7fbb6c0721e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbb600097a0 tx=0x7fbb6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e39e6fcfe23320 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.999+0000 7fbb6affd640 1 -- 172.21.15.114:0/4103895715 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60035020 con 0x7fbb6c0affc0 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.999+0000 7fbb6affd640 1 -- 172.21.15.114:0/4103895715 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb60031830 con 0x7fbb6c0affc0 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:58.999+0000 7fbb6affd640 1 -- 172.21.15.114:0/4103895715 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60031c00 con 0x7fbb6c0affc0 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 -- 172.21.15.114:0/4103895715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c0affc0 msgr2=0x7fbb6c0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 --2- 172.21.15.114:0/4103895715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c0affc0 0x7fbb6c0721e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbb600097a0 tx=0x7fbb6002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 -- 172.21.15.114:0/4103895715 shutdown_connections 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 --2- 172.21.15.114:0/4103895715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c0affc0 0x7fbb6c0721e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 --2- 172.21.15.114:0/4103895715 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c1481f0 0x7fbb6c15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 -- 172.21.15.114:0/4103895715 >> 172.21.15.114:0/4103895715 conn(0x7fbb6c0b27b0 msgr2=0x7fbb6c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:59.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 -- 172.21.15.114:0/4103895715 shutdown_connections 2024-04-13T02:44:59.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.000+0000 7fbb72680640 1 -- 172.21.15.114:0/4103895715 wait complete. 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.001+0000 7fbb72680640 1 Processor -- start 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.001+0000 7fbb72680640 1 -- start start 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb72680640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c0affc0 0x7fbb6c0b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb72680640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb6c0b5560 0x7fbb6c13d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb72680640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 0x7fbb6c1f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb72680640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c0afaa0 con 0x7fbb6c1481f0 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb72680640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c0af7c0 con 0x7fbb6c0b5560 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb72680640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6c072720 con 0x7fbb6c0affc0 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 0x7fbb6c1f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:59.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 0x7fbb6c1f3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37510/0 (socket says 172.21.15.114:37510) 2024-04-13T02:44:59.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 -- 172.21.15.114:0/1547423664 learned_addr learned my addr 172.21.15.114:0/1547423664 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:44:59.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb6bfff640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c0affc0 0x7fbb6c0b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:59.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb6b7fe640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb6c0b5560 0x7fbb6c13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:59.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 -- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c0affc0 msgr2=0x7fbb6c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:59.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c0affc0 0x7fbb6c0b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 -- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb6c0b5560 msgr2=0x7fbb6c13d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb6c0b5560 0x7fbb6c13d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.002+0000 7fbb70c1d640 1 -- 172.21.15.114:0/1547423664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c13db80 con 0x7fbb6c1481f0 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.003+0000 7fbb70c1d640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 0x7fbb6c1f3ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400caf0 tx=0x7fbb6400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.003+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6400aca0 con 0x7fbb6c1481f0 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.003+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6400ae40 con 0x7fbb6c1481f0 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.003+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c13de20 con 0x7fbb6c1481f0 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.003+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64012640 con 0x7fbb6c1481f0 2024-04-13T02:44:59.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.003+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c13e3e0 con 0x7fbb6c1481f0 2024-04-13T02:44:59.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.004+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c068c80 con 0x7fbb6c1481f0 2024-04-13T02:44:59.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.004+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb640128a0 con 0x7fbb6c1481f0 2024-04-13T02:44:59.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.005+0000 7fbb68ff9640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbb5806c8f0 0x7fbb5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:44:59.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.005+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb6408bff0 con 0x7fbb6c1481f0 2024-04-13T02:44:59.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.005+0000 7fbb6bfff640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbb5806c8f0 0x7fbb5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:44:59.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.005+0000 7fbb6bfff640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbb5806c8f0 0x7fbb5806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0098e0 tx=0x7fbb5c009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:44:59.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.009+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb64059e60 con 0x7fbb6c1481f0 2024-04-13T02:44:59.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.223+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbb6c1f4000 con 0x7fbb6c1481f0 2024-04-13T02:44:59.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.223+0000 7fbb68ff9640 1 -- 172.21.15.114:0/1547423664 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fbb6405e160 con 0x7fbb6c1481f0 2024-04-13T02:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-13T02:44:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbb5806c8f0 msgr2=0x7fbb5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbb5806c8f0 0x7fbb5806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0098e0 tx=0x7fbb5c009060 comp rx=0 tx=0).stop 2024-04-13T02:44:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 msgr2=0x7fbb6c1f3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 0x7fbb6c1f3ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400caf0 tx=0x7fbb6400a060 comp rx=0 tx=0).stop 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 shutdown_connections 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c1481f0 0x7fbb6c1f3ac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbb6c0b5560 0x7fbb6c13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbb5806c8f0 0x7fbb5806edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 --2- 172.21.15.114:0/1547423664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbb6c0affc0 0x7fbb6c0b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 >> 172.21.15.114:0/1547423664 conn(0x7fbb6c0b27b0 msgr2=0x7fbb6c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 shutdown_connections 2024-04-13T02:44:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:44:59.225+0000 7fbb72680640 1 -- 172.21.15.114:0/1547423664 wait complete. 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T02:44:59.237 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-13T02:44:59.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.238 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:59.254 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42721sec preferred_lft 42721sec 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:44:59.255 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether d2:3a:d8:9a:82:14 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::e487:f2ff:fecf:dddf/64 scope link 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether d2:3a:d8:9a:82:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::d03a:d8ff:fe9a:8214/64 scope link tentative 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.256 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T02:44:59.321 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-13T02:44:59.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.323 DEBUG:teuthology.orchestra.run.smithi130:> route 2024-04-13T02:44:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2024-04-13T02:44:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T02:44:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T02:44:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T02:44:59.379 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T02:44:59.380 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:59.380 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:59.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T02:44:59.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T02:44:59.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T02:44:59.380 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:59.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:59.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:59.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.514 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-13T02:44:59.528 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-13T02:44:59.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.529 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2024-04-13T02:44:59.583 INFO:teuthology.orchestra.run.smithi130.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-13T02:44:59.583 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:59.583 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:59.583 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-13T02:44:59.583 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-13T02:44:59.583 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:59.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:59.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:59.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.705 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-13T02:44:59.731 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether ca:28:be:11:73:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c828:beff:fe11:736b/64 scope link tentative 2024-04-13T02:44:59.732 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:44:59.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether ca:28:be:11:73:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-13T02:44:59.800 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-13T02:44:59.801 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.801 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c828:beff:fe11:736b/64 scope link tentative 2024-04-13T02:44:59.801 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:44:59.802 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-13T02:44:59.802 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:44:59.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:44:59.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:44:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:44:59.965 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:44:59.965 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-13T02:44:59.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.1 up 2024-04-13T02:44:59.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.1 master ceph-brx 2024-04-13T02:44:59.965 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-13T02:45:00.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:45:00.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:00.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:45:00.046 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-13T02:45:00.073 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-13T02:45:00.073 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:45:00.073 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-13T02:45:00.128 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-13T02:45:00.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:00.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-13T02:45:00.212 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-13T02:45:00.212 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-13T02:45:00.212 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-13T02:45:00.220 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-13T02:45:00.220 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-13T02:45:00.220 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-13T02:45:00.220 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:45:00.220 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-13T02:45:00.226 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=202cca92-4b79-424a-b5f1-59b181ba42ec" will pass to kernel 2024-04-13T02:45:00.227 INFO:teuthology.orchestra.run.smithi130.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-13T02:45:00.227 INFO:teuthology.orchestra.run.smithi130.stdout: You just mounted a file system that supports labels which does not 2024-04-13T02:45:00.227 INFO:teuthology.orchestra.run.smithi130.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-13T02:45:00.227 INFO:teuthology.orchestra.run.smithi130.stdout: applications will generate AVC messages and not be allowed access to 2024-04-13T02:45:00.227 INFO:teuthology.orchestra.run.smithi130.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-13T02:45:00.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-13T02:45:00.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:00.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-13T02:45:00.296 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:45:00.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:45:00.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:00.391 INFO:teuthology.orchestra.run.smithi130.stdout:client4716 2024-04-13T02:45:00.391 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:00.392 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:00.407 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:45:00.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:45:00.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:00.502 INFO:teuthology.orchestra.run.smithi130.stdout:client4716 2024-04-13T02:45:00.502 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:45:00.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:45:00.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:00.556 INFO:teuthology.orchestra.run.smithi130.stdout:client4716 2024-04-13T02:45:00.556 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/202cca92-4b79-424a-b5f1-59b181ba42ec.client4716/status') 2024-04-13T02:45:00.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:45:00.617 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4716 (3)172.21.15.130:0/1860946261 2024-04-13T02:45:00.617 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2024-04-13T02:45:00.617 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2024-04-13T02:45:00.618 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2024-04-13T02:45:00.618 INFO:teuthology.orchestra.run.smithi130.stderr:71 bytes copied, 1.9952e-05 s, 3.6 MB/s 2024-04-13T02:45:00.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-13T02:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:00.625 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-13T02:45:00.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.755+0000 7f3d15f5e640 1 Processor -- start 2024-04-13T02:45:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.755+0000 7f3d15f5e640 1 -- start start 2024-04-13T02:45:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.755+0000 7f3d15f5e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d1015eac0 0x7f3d100d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.755+0000 7f3d15f5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 0x7f3d100d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d15f5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d100d1cb0 con 0x7f3d100d1840 2024-04-13T02:45:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d15f5e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3d100d2d90 con 0x7f3d1015eac0 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d15f5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3d100d3070 con 0x7f3d100d43c0 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3d100d1840 0x7f3d100b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38760/0 (socket says 172.21.15.114:38760) 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0ffff640 1 -- 172.21.15.114:0/813370996 learned_addr learned my addr 172.21.15.114:0/813370996 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153245876 0 0) 0x7f3d100d1cb0 con 0x7f3d100d1840 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0f7fe640 1 --2- 172.21.15.114:0/813370996 >> v2:172.21.15.130:3300/0 conn(0x7f3d1015eac0 0x7f3d100d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf8003520 con 0x7f3d100d1840 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0effd640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 0x7f3d100d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985757130 0 0) 0x7f3cf8003520 con 0x7f3d100d1840 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 msgr2=0x7f3d100d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 0x7f3d100d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 >> v2:172.21.15.130:3300/0 conn(0x7f3d1015eac0 msgr2=0x7f3d100d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 --2- 172.21.15.114:0/813370996 >> v2:172.21.15.130:3300/0 conn(0x7f3d1015eac0 0x7f3d100d3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d100d3350 con 0x7f3d100d1840 2024-04-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f3d080019f0 con 0x7f3d100d1840 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 >> v1:172.21.15.114:6789/0 conn(0x7f3d100d1840 legacy=0x7f3d100b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 0x7f3cf80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cf8003f30 0x7f3cf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cf8004d40 0x7f3cf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100d2d90 con 0x7f3cf8003f30 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100d3070 con 0x7f3cf8004d40 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf800b9c0 con 0x7f3d100d43c0 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.756+0000 7f3d0effd640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cf8003f30 0x7f3cf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0f7fe640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 0x7f3cf80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0ffff640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cf8004d40 0x7f3cf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0effd640 1 -- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 msgr2=0x7f3cf80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0effd640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d100d43c0 0x7f3cf80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0effd640 1 -- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cf8004d40 msgr2=0x7f3cf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0effd640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cf8004d40 0x7f3cf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.757+0000 7f3d0effd640 1 -- 172.21.15.114:0/813370996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf8003520 con 0x7f3cf8003f30 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d0effd640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cf8003f30 0x7f3cf8004800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009ac0 tx=0x7f3cf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319586a759215914 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04039070 con 0x7f3cf8003f30 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0402c6b0 con 0x7f3cf8003f30 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d0e7fc640 1 -- 172.21.15.114:0/813370996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04009690 con 0x7f3cf8003f30 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d15f5e640 1 -- 172.21.15.114:0/813370996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cf8003f30 msgr2=0x7f3cf8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/813370996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cf8003f30 0x7f3cf8004800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009ac0 tx=0x7f3cf8005830 comp rx=0 tx=0).stop 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d0ffff640 1 -- 172.21.15.114:0/813370996 reap_dead start 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d15f5e640 1 -- 172.21.15.114:0/813370996 shutdown_connections 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d15f5e640 1 -- 172.21.15.114:0/813370996 >> 172.21.15.114:0/813370996 conn(0x7f3d10073690 msgr2=0x7f3d1006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d15f5e640 1 -- 172.21.15.114:0/813370996 shutdown_connections 2024-04-13T02:45:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.758+0000 7f3d15f5e640 1 -- 172.21.15.114:0/813370996 wait complete. 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.759+0000 7f3d15f5e640 1 Processor -- start 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 -- start start 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3cf8003f30 0x7f3d100ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d100cca60 0x7f3d100ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 0x7f3d10156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1015eea0 con 0x7f3d10147520 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100d3910 con 0x7f3d100cca60 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d15f5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3d100d29f0 con 0x7f3cf8003f30 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d0ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 0x7f3d10156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d0ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 0x7f3d10156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37530/0 (socket says 172.21.15.114:37530) 2024-04-13T02:45:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.760+0000 7f3d0ffff640 1 -- 172.21.15.114:0/1446987139 learned_addr learned my addr 172.21.15.114:0/1446987139 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0ffff640 1 -- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3cf8003f30 msgr2=0x7f3d100ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0f7fe640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3cf8003f30 0x7f3d100ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0effd640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d100cca60 0x7f3d100ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0ffff640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3cf8003f30 0x7f3d100ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0ffff640 1 -- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d100cca60 msgr2=0x7f3d100ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0ffff640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d100cca60 0x7f3d100ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0ffff640 1 -- 172.21.15.114:0/1446987139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d100ce5e0 con 0x7f3d10147520 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0effd640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d100cca60 0x7f3d100ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0f7fe640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3cf8003f30 0x7f3d100ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d0ffff640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 0x7f3d10156f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d100b7820 tx=0x7f3d08007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08019070 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0800abe0 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d100cd000 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d080133f0 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.761+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d100cd5c0 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.762+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d10068c80 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.762+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d0801c070 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.763+0000 7f3cf7fff640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3cfc06c920 0x7f3cfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.763+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3d0808b6f0 con 0x7f3d10147520 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.763+0000 7f3d0f7fe640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3cfc06c920 0x7f3cfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.763+0000 7f3d0f7fe640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3cfc06c920 0x7f3cfc06ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009b30 tx=0x7f3d00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:00.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.767+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d08059b20 con 0x7f3d10147520 2024-04-13T02:45:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.944+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d1015d870 con 0x7f3d10147520 2024-04-13T02:45:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.945+0000 7f3cf7fff640 1 -- 172.21.15.114:0/1446987139 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f3d08059420 con 0x7f3d10147520 2024-04-13T02:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3cfc06c920 msgr2=0x7f3cfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3cfc06c920 0x7f3cfc06ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009b30 tx=0x7f3d00008040 comp rx=0 tx=0).stop 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 msgr2=0x7f3d10156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 0x7f3d10156f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d100b7820 tx=0x7f3d08007b20 comp rx=0 tx=0).stop 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 shutdown_connections 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d10147520 0x7f3d10156f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d100cca60 0x7f3d100ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3cfc06c920 0x7f3cfc06ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 --2- 172.21.15.114:0/1446987139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3cf8003f30 0x7f3d100ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 >> 172.21.15.114:0/1446987139 conn(0x7f3d10073690 msgr2=0x7f3d100b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 shutdown_connections 2024-04-13T02:45:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:00.947+0000 7f3d15f5e640 1 -- 172.21.15.114:0/1446987139 wait complete. 2024-04-13T02:45:00.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:00.959 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:01.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 Processor -- start 2024-04-13T02:45:01.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 -- start start 2024-04-13T02:45:01.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc458073020 0x7fc4580b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc45806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4580b0180 con 0x7fc458148580 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc4580b0460 con 0x7fc458073020 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.062+0000 7fc45f17b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc45806e5f0 con 0x7fc4580b5100 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc457fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc458073020 0x7fc4580b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc45cf17640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc458148580 0x7fc4580af930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38762/0 (socket says 172.21.15.114:38762) 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc45cf17640 1 -- 172.21.15.114:0/2279358905 learned_addr learned my addr 172.21.15.114:0/2279358905 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc45d718640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc45806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc457fff640 1 -- 172.21.15.114:0/2279358905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 msgr2=0x7fc45806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc457fff640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc45806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc457fff640 1 -- 172.21.15.114:0/2279358905 >> v1:172.21.15.114:6789/0 conn(0x7fc458148580 legacy=0x7fc4580af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc457fff640 1 -- 172.21.15.114:0/2279358905 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45806e8d0 con 0x7fc458073020 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc4577fe640 1 -- 172.21.15.114:0/2279358905 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133581209 0 0) 0x7fc4580b0180 con 0x7fc458148580 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.063+0000 7fc45d718640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc45806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc457fff640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458073020 0x7fc4580b4bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0097a0 tx=0x7fc44c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e77a53ea826791f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc4577fe640 1 -- 172.21.15.114:0/2279358905 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c035020 con 0x7fc458073020 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc4577fe640 1 -- 172.21.15.114:0/2279358905 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c031830 con 0x7fc458073020 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc4577fe640 1 -- 172.21.15.114:0/2279358905 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c031c00 con 0x7fc458073020 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 -- 172.21.15.114:0/2279358905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458073020 msgr2=0x7fc4580b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458073020 0x7fc4580b4bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0097a0 tx=0x7fc44c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 -- 172.21.15.114:0/2279358905 shutdown_connections 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc45806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 --2- 172.21.15.114:0/2279358905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458073020 0x7fc4580b4bc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 -- 172.21.15.114:0/2279358905 >> 172.21.15.114:0/2279358905 conn(0x7fc458072530 msgr2=0x7fc458072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 -- 172.21.15.114:0/2279358905 shutdown_connections 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.064+0000 7fc45f17b640 1 -- 172.21.15.114:0/2279358905 wait complete. 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.065+0000 7fc45f17b640 1 Processor -- start 2024-04-13T02:45:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.065+0000 7fc45f17b640 1 -- start start 2024-04-13T02:45:01.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45f17b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc458073020 0x7fc4581581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45f17b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc4580ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45f17b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 0x7fc45815fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45f17b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc45806f790 con 0x7fc458148580 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45f17b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc45806f610 con 0x7fc458073020 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45f17b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc45806f910 con 0x7fc4580b5100 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45d718640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 0x7fc45815fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45d718640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 0x7fc45815fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37548/0 (socket says 172.21.15.114:37548) 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.066+0000 7fc45d718640 1 -- 172.21.15.114:0/546727673 learned_addr learned my addr 172.21.15.114:0/546727673 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc457fff640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc4580ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45cf17640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc458073020 0x7fc4581581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45d718640 1 -- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 msgr2=0x7fc4580ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45d718640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc4580ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45d718640 1 -- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc458073020 msgr2=0x7fc4581581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45d718640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc458073020 0x7fc4581581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45d718640 1 -- 172.21.15.114:0/546727673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4580ceec0 con 0x7fc458148580 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45d718640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 0x7fc45815fbb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc44800e810 tx=0x7fc44800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44800f040 con 0x7fc458148580 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc448004030 con 0x7fc458148580 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4580cf1a0 con 0x7fc458148580 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4480043e0 con 0x7fc458148580 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.067+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45815f690 con 0x7fc458148580 2024-04-13T02:45:01.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.068+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc458070550 con 0x7fc458148580 2024-04-13T02:45:01.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.068+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc44800c6d0 con 0x7fc458148580 2024-04-13T02:45:01.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.069+0000 7fc4557fa640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc44406c8f0 0x7fc44406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.069+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc44808b7d0 con 0x7fc458148580 2024-04-13T02:45:01.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.069+0000 7fc45cf17640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc44406c8f0 0x7fc44406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.069+0000 7fc45cf17640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc44406c8f0 0x7fc44406edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc450007ed0 tx=0x7fc450007e60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.073+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc458070550 con 0x7fc458148580 2024-04-13T02:45:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.249+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc458067860 con 0x7fc458148580 2024-04-13T02:45:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.250+0000 7fc4557fa640 1 -- 172.21.15.114:0/546727673 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc448017020 con 0x7fc458148580 2024-04-13T02:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc44406c8f0 msgr2=0x7fc44406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc44406c8f0 0x7fc44406edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc450007ed0 tx=0x7fc450007e60 comp rx=0 tx=0).stop 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 msgr2=0x7fc45815fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 0x7fc45815fbb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc44800e810 tx=0x7fc44800ecd0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 shutdown_connections 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc458148580 0x7fc45815fbb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc44406c8f0 0x7fc44406edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4580b5100 0x7fc4580ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 --2- 172.21.15.114:0/546727673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc458073020 0x7fc4581581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 >> 172.21.15.114:0/546727673 conn(0x7fc458072530 msgr2=0x7fc458072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 shutdown_connections 2024-04-13T02:45:01.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.252+0000 7fc45f17b640 1 -- 172.21.15.114:0/546727673 wait complete. 2024-04-13T02:45:01.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:01.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.367+0000 7f31ad488640 1 Processor -- start 2024-04-13T02:45:01.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.367+0000 7f31ad488640 1 -- start start 2024-04-13T02:45:01.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.367+0000 7f31ad488640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a815ecc0 0x7f31a80d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.367+0000 7f31ad488640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f31a80d3270 0x7f31a80b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.367+0000 7f31ad488640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a80ba4d0 con 0x7f31a80b3720 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f31ad488640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f31a815f0a0 con 0x7f31a80d3270 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f31ad488640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f31a80ba280 con 0x7f31a815ecc0 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f31a80d3270 0x7f31a80b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f31a80d3270 0x7f31a80b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37556/0 (socket says 172.21.15.114:37556) 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 -- 172.21.15.114:0/1704113733 learned_addr learned my addr 172.21.15.114:0/1704113733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f31a6ffd640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a815ecc0 0x7f31a80d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 -- 172.21.15.114:0/1704113733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a815ecc0 msgr2=0x7f31a80d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a815ecc0 0x7f31a80d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 -- 172.21.15.114:0/1704113733 >> v1:172.21.15.130:6789/0 conn(0x7f31a80b3720 legacy=0x7f31a80cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f319ffff640 1 -- 172.21.15.114:0/1704113733 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a80ba7b0 con 0x7f31a80d3270 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.368+0000 7f31a6ffd640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a815ecc0 0x7f31a80d2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f319ffff640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a80d3270 0x7f31a80b95f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3190009870 tx=0x7f319002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219c0b2310cec6e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31a67fc640 1 -- 172.21.15.114:0/1704113733 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190034070 con 0x7f31a80d3270 2024-04-13T02:45:01.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31a67fc640 1 -- 172.21.15.114:0/1704113733 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3190030840 con 0x7f31a80d3270 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31a67fc640 1 -- 172.21.15.114:0/1704113733 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190030c10 con 0x7f31a80d3270 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 -- 172.21.15.114:0/1704113733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a80d3270 msgr2=0x7f31a80b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a80d3270 0x7f31a80b95f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3190009870 tx=0x7f319002b980 comp rx=0 tx=0).stop 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 -- 172.21.15.114:0/1704113733 shutdown_connections 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a80d3270 0x7f31a80b95f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 --2- 172.21.15.114:0/1704113733 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a815ecc0 0x7f31a80d2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 -- 172.21.15.114:0/1704113733 >> 172.21.15.114:0/1704113733 conn(0x7f31a8073480 msgr2=0x7f31a8073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 -- 172.21.15.114:0/1704113733 shutdown_connections 2024-04-13T02:45:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.369+0000 7f31ad488640 1 -- 172.21.15.114:0/1704113733 wait complete. 2024-04-13T02:45:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 Processor -- start 2024-04-13T02:45:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 -- start start 2024-04-13T02:45:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31a80b3720 0x7f31a814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a80d3270 0x7f31a80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 0x7f31a80c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f31a80b8aa0 con 0x7f31a815ecc0 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f31a80b90d0 con 0x7f31a80b3720 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31ad488640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f31a80cfdb0 con 0x7f31a80d3270 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31a77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 0x7f31a80c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31a77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 0x7f31a80c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37572/0 (socket says 172.21.15.114:37572) 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.371+0000 7f31a77fe640 1 -- 172.21.15.114:0/3654955580 learned_addr learned my addr 172.21.15.114:0/3654955580 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a6ffd640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31a80b3720 0x7f31a814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f319ffff640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a80d3270 0x7f31a80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a77fe640 1 -- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a80d3270 msgr2=0x7f31a80c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a77fe640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a80d3270 0x7f31a80c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a77fe640 1 -- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31a80b3720 msgr2=0x7f31a814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a77fe640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31a80b3720 0x7f31a814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a77fe640 1 -- 172.21.15.114:0/3654955580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a80cb090 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a6ffd640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31a80b3720 0x7f31a814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f319ffff640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a80d3270 0x7f31a80c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31a77fe640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 0x7f31a80c93c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c7d0 tx=0x7f31a000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003b70 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a0003d30 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a000aa90 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a814e6f0 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.372+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a815f630 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.373+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a80d2cb0 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.373+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31a000ac30 con 0x7f31a815ecc0 2024-04-13T02:45:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.374+0000 7f319f7fe640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f318806c8f0 0x7f318806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.374+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31a008ba20 con 0x7f31a815ecc0 2024-04-13T02:45:01.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.374+0000 7f31a6ffd640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f318806c8f0 0x7f318806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.374+0000 7f31a6ffd640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f318806c8f0 0x7f318806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3198006fd0 tx=0x7f3198008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.378+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31a0059ee0 con 0x7f31a815ecc0 2024-04-13T02:45:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.553+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f31a80b5e90 con 0x7f31a815ecc0 2024-04-13T02:45:01.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.554+0000 7f319f7fe640 1 -- 172.21.15.114:0/3654955580 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f31a00597e0 con 0x7f31a815ecc0 2024-04-13T02:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f318806c8f0 msgr2=0x7f318806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f318806c8f0 0x7f318806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3198006fd0 tx=0x7f3198008040 comp rx=0 tx=0).stop 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 msgr2=0x7f31a80c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 0x7f31a80c93c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c7d0 tx=0x7f31a000cc90 comp rx=0 tx=0).stop 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 shutdown_connections 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31a815ecc0 0x7f31a80c93c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f318806c8f0 0x7f318806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31a80d3270 0x7f31a80c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 --2- 172.21.15.114:0/3654955580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31a80b3720 0x7f31a814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 >> 172.21.15.114:0/3654955580 conn(0x7f31a8073480 msgr2=0x7f31a806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 shutdown_connections 2024-04-13T02:45:01.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.556+0000 7f31ad488640 1 -- 172.21.15.114:0/3654955580 wait complete. 2024-04-13T02:45:01.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 Processor -- start 2024-04-13T02:45:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 -- start start 2024-04-13T02:45:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2a006f260 0x7ff2a006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a00b4410 con 0x7ff2a00ce070 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a0145550 con 0x7ff2a006f260 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.670+0000 7ff2a6b8c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a00b46f0 con 0x7ff2a0145170 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a5129640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2a006f260 0x7ff2a006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff29ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2a00ce070 0x7ff2a00b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38774/0 (socket says 172.21.15.114:38774) 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff29ffff640 1 -- 172.21.15.114:0/3018069450 learned_addr learned my addr 172.21.15.114:0/3018069450 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a4928640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a5129640 1 -- 172.21.15.114:0/3018069450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 msgr2=0x7ff2a00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a5129640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a00cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a5129640 1 -- 172.21.15.114:0/3018069450 >> v1:172.21.15.114:6789/0 conn(0x7ff2a00ce070 legacy=0x7ff2a00b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a5129640 1 -- 172.21.15.114:0/3018069450 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a00b49d0 con 0x7ff2a006f260 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.671+0000 7ff2a4928640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a5129640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a006f260 0x7ff2a006f6f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff2900097a0 tx=0x7ff29002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c89c1191dacf1a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff29f7fe640 1 -- 172.21.15.114:0/3018069450 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290035020 con 0x7ff2a006f260 2024-04-13T02:45:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff29f7fe640 1 -- 172.21.15.114:0/3018069450 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff290031830 con 0x7ff2a006f260 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff29f7fe640 1 -- 172.21.15.114:0/3018069450 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290031c00 con 0x7ff2a006f260 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/3018069450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a006f260 msgr2=0x7ff2a006f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a006f260 0x7ff2a006f6f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff2900097a0 tx=0x7ff29002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/3018069450 shutdown_connections 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a006f260 0x7ff2a006f6f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/3018069450 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/3018069450 >> 172.21.15.114:0/3018069450 conn(0x7ff2a00b2460 msgr2=0x7ff2a00b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/3018069450 shutdown_connections 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.672+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/3018069450 wait complete. 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.673+0000 7ff2a6b8c640 1 Processor -- start 2024-04-13T02:45:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.673+0000 7ff2a6b8c640 1 -- start start 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff2a6b8c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2a006f260 0x7ff2a01391d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff2a6b8c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 0x7ff2a0135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff2a6b8c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a0142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff2a6b8c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a00b5bc0 con 0x7ff2a00ce070 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff2a6b8c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a00b4f90 con 0x7ff2a006f260 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff2a6b8c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a00b4030 con 0x7ff2a0145170 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.674+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 0x7ff2a0135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 0x7ff2a0135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37588/0 (socket says 172.21.15.114:37588) 2024-04-13T02:45:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 -- 172.21.15.114:0/4096154890 learned_addr learned my addr 172.21.15.114:0/4096154890 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff2a5129640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a0142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff2a4928640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2a006f260 0x7ff2a01391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 -- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 msgr2=0x7ff2a0142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a0142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 -- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2a006f260 msgr2=0x7ff2a01391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2a006f260 0x7ff2a01391d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 -- 172.21.15.114:0/4096154890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a01342b0 con 0x7ff2a00ce070 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff2a4928640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2a006f260 0x7ff2a01391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff2a5129640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a0142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29ffff640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 0x7ff2a0135cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c440 tx=0x7ff288001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288017070 con 0x7ff2a00ce070 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288005ce0 con 0x7ff2a00ce070 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a0134590 con 0x7ff2a00ce070 2024-04-13T02:45:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880072f0 con 0x7ff2a00ce070 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.675+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a0134b50 con 0x7ff2a00ce070 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.676+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a0134f30 con 0x7ff2a00ce070 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.676+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff28801a070 con 0x7ff2a00ce070 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.677+0000 7ff29d7fa640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff28006c8f0 0x7ff28006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.677+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff28808af40 con 0x7ff2a00ce070 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.677+0000 7ff2a4928640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff28006c8f0 0x7ff28006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.677+0000 7ff2a4928640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff28006c8f0 0x7ff28006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00b0920 tx=0x7ff2980074b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.681+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2a0134f30 con 0x7ff2a00ce070 2024-04-13T02:45:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.858+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff2a0068c80 con 0x7ff2a00ce070 2024-04-13T02:45:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.858+0000 7ff29d7fa640 1 -- 172.21.15.114:0/4096154890 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff28805f030 con 0x7ff2a00ce070 2024-04-13T02:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff28006c8f0 msgr2=0x7ff28006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff28006c8f0 0x7ff28006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00b0920 tx=0x7ff2980074b0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 msgr2=0x7ff2a0135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 0x7ff2a0135cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c440 tx=0x7ff288001e70 comp rx=0 tx=0).stop 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 shutdown_connections 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff28006c8f0 0x7ff28006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2a0145170 0x7ff2a0142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ce070 0x7ff2a0135cb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 --2- 172.21.15.114:0/4096154890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2a006f260 0x7ff2a01391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 >> 172.21.15.114:0/4096154890 conn(0x7ff2a00b2460 msgr2=0x7ff2a013d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 shutdown_connections 2024-04-13T02:45:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.860+0000 7ff2a6b8c640 1 -- 172.21.15.114:0/4096154890 wait complete. 2024-04-13T02:45:01.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:01.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.971+0000 7f04575a5640 1 Processor -- start 2024-04-13T02:45:01.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.971+0000 7f04575a5640 1 -- start start 2024-04-13T02:45:01.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f04575a5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f04500d3e20 0x7f04500d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f04575a5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f04500cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f04575a5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04500b89f0 con 0x7f04500cf6f0 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f04575a5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f04500cfba0 con 0x7f04500d3e20 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f04575a5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f04500d2b10 con 0x7f045015ee00 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f0455b42640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f04500cf6f0 0x7f04500b63d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38778/0 (socket says 172.21.15.114:38778) 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f0455b42640 1 -- 172.21.15.114:0/2666911083 learned_addr learned my addr 172.21.15.114:0/2666911083 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.972+0000 7f0455341640 1 --2- 172.21.15.114:0/2666911083 >> v2:172.21.15.130:3300/0 conn(0x7f04500d3e20 0x7f04500d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f04500cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126786388 0 0) 0x7f04500b89f0 con 0x7f04500cf6f0 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f043c003520 con 0x7f04500cf6f0 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3259885256 0 0) 0x7f043c003520 con 0x7f04500cf6f0 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 msgr2=0x7f04500cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f04500cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 >> v2:172.21.15.130:3300/0 conn(0x7f04500d3e20 msgr2=0x7f04500d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 --2- 172.21.15.114:0/2666911083 >> v2:172.21.15.130:3300/0 conn(0x7f04500d3e20 0x7f04500d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500d4740 con 0x7f04500cf6f0 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0455341640 1 --2- 172.21.15.114:0/2666911083 >> v2:172.21.15.130:3300/0 conn(0x7f04500d3e20 0x7f04500d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f0448001670 con 0x7f04500cf6f0 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 >> v1:172.21.15.114:6789/0 conn(0x7f04500cf6f0 legacy=0x7f04500b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f043c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f043c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c004d40 0x7f043c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f04500cfba0 con 0x7f043c003f30 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04500d2b10 con 0x7f043c004d40 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f043c00b9f0 con 0x7f045015ee00 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f043c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0455341640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f043c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0455b42640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c004d40 0x7f043c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 -- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 msgr2=0x7f043c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f043c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 -- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c004d40 msgr2=0x7f043c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c004d40 0x7f043c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0454b40640 1 -- 172.21.15.114:0/2666911083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c003520 con 0x7f043c003f30 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0455341640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f045015ee00 0x7f043c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.973+0000 7f0455b42640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f043c004d40 0x7f043c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.974+0000 7f0454b40640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f043c004800 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0440009a90 tx=0x7f043c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91883a97475ed71e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.974+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440039070 con 0x7f043c003f30 2024-04-13T02:45:01.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.974+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044002c680 con 0x7f043c003f30 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.974+0000 7f0447fff640 1 -- 172.21.15.114:0/2666911083 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440009690 con 0x7f043c003f30 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f04575a5640 1 -- 172.21.15.114:0/2666911083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 msgr2=0x7f043c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f04575a5640 1 --2- 172.21.15.114:0/2666911083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f043c004800 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0440009a90 tx=0x7f043c005830 comp rx=0 tx=0).stop 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f0455b42640 1 -- 172.21.15.114:0/2666911083 reap_dead start 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f04575a5640 1 -- 172.21.15.114:0/2666911083 shutdown_connections 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f04575a5640 1 -- 172.21.15.114:0/2666911083 >> 172.21.15.114:0/2666911083 conn(0x7f045006d470 msgr2=0x7f045006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f04575a5640 1 -- 172.21.15.114:0/2666911083 shutdown_connections 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.975+0000 7f04575a5640 1 -- 172.21.15.114:0/2666911083 wait complete. 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.976+0000 7f04575a5640 1 Processor -- start 2024-04-13T02:45:01.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.976+0000 7f04575a5640 1 -- start start 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f0450153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f045015cfc0 0x7f04500c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04500ca6e0 0x7f04500cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f04500d2d60 con 0x7f043c003f30 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f04500d33b0 con 0x7f045015cfc0 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f04500d3040 con 0x7f04500ca6e0 2024-04-13T02:45:01.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f0450153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f0450153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37612/0 (socket says 172.21.15.114:37612) 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 -- 172.21.15.114:0/1292974294 learned_addr learned my addr 172.21.15.114:0/1292974294 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0454b40640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f045015cfc0 0x7f04500c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455b42640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04500ca6e0 0x7f04500cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 -- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04500ca6e0 msgr2=0x7f04500cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04500ca6e0 0x7f04500cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 -- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f045015cfc0 msgr2=0x7f04500c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f045015cfc0 0x7f04500c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 -- 172.21.15.114:0/1292974294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500c8dd0 con 0x7f043c003f30 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0454b40640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f045015cfc0 0x7f04500c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0455341640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f0450153c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f044c011500 tx=0x7f044c0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c01a020 con 0x7f043c003f30 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c016680 con 0x7f043c003f30 2024-04-13T02:45:01.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04500c90b0 con 0x7f043c003f30 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.977+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c016a30 con 0x7f043c003f30 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.978+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04500c9670 con 0x7f043c003f30 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.979+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0450068c80 con 0x7f043c003f30 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.979+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f044c005d10 con 0x7f043c003f30 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.979+0000 7f0445ffb640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f043406c8f0 0x7f043406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.979+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f044c08cd90 con 0x7f043c003f30 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.979+0000 7f0454b40640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f043406c8f0 0x7f043406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.980+0000 7f0454b40640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f043406c8f0 0x7f043406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0440036000 tx=0x7f0440030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:01.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:01.983+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f044c024030 con 0x7f043c003f30 2024-04-13T02:45:02.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.159+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04500b39a0 con 0x7f043c003f30 2024-04-13T02:45:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.161+0000 7f0445ffb640 1 -- 172.21.15.114:0/1292974294 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f044c05b1d0 con 0x7f043c003f30 2024-04-13T02:45:02.162 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:02.162 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f043406c8f0 msgr2=0x7f043406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f043406c8f0 0x7f043406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0440036000 tx=0x7f0440030000 comp rx=0 tx=0).stop 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 msgr2=0x7f0450153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f0450153c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f044c011500 tx=0x7f044c0119c0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 shutdown_connections 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f043406c8f0 0x7f043406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f04500ca6e0 0x7f04500cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f045015cfc0 0x7f04500c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 --2- 172.21.15.114:0/1292974294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f043c003f30 0x7f0450153c40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 >> 172.21.15.114:0/1292974294 conn(0x7f045006d470 msgr2=0x7f045015e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:02.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 shutdown_connections 2024-04-13T02:45:02.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.163+0000 7f04575a5640 1 -- 172.21.15.114:0/1292974294 wait complete. 2024-04-13T02:45:02.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:02.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:02.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.277+0000 7fe47b7b4640 1 Processor -- start 2024-04-13T02:45:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.278+0000 7fe47b7b4640 1 -- start start 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.278+0000 7fe47b7b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4740d2370 0x7fe47409ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe47b7b4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47406deb0 con 0x7fe4741622c0 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe47b7b4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47406d6a0 con 0x7fe47406d150 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe47b7b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe47406dc60 con 0x7fe4740d2370 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe479550640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe4741622c0 0x7fe47406ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38784/0 (socket says 172.21.15.114:38784) 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe479550640 1 -- 172.21.15.114:0/314924345 learned_addr learned my addr 172.21.15.114:0/314924345 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe478d4f640 1 --2- 172.21.15.114:0/314924345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4740d2370 0x7fe47409ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe478d4f640 1 -- 172.21.15.114:0/314924345 >> v1:172.21.15.130:6789/0 conn(0x7fe47406d150 legacy=0x7fe47409b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe478d4f640 1 -- 172.21.15.114:0/314924345 >> v1:172.21.15.114:6789/0 conn(0x7fe4741622c0 legacy=0x7fe47406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.279+0000 7fe478d4f640 1 -- 172.21.15.114:0/314924345 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47406d980 con 0x7fe4740d2370 2024-04-13T02:45:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.280+0000 7fe478d4f640 1 --2- 172.21.15.114:0/314924345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4740d2370 0x7fe47409ab90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4640097d0 tx=0x7fe46402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663d6aef7b7b28d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.281+0000 7fe46bfff640 1 -- 172.21.15.114:0/314924345 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464035020 con 0x7fe4740d2370 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.281+0000 7fe46bfff640 1 -- 172.21.15.114:0/314924345 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe464031890 con 0x7fe4740d2370 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.281+0000 7fe46bfff640 1 -- 172.21.15.114:0/314924345 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464031c60 con 0x7fe4740d2370 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 -- 172.21.15.114:0/314924345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4740d2370 msgr2=0x7fe47409ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/314924345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4740d2370 0x7fe47409ab90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4640097d0 tx=0x7fe46402b930 comp rx=0 tx=0).stop 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 -- 172.21.15.114:0/314924345 shutdown_connections 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/314924345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4740d2370 0x7fe47409ab90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 -- 172.21.15.114:0/314924345 >> 172.21.15.114:0/314924345 conn(0x7fe4740d2750 msgr2=0x7fe4740d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 -- 172.21.15.114:0/314924345 shutdown_connections 2024-04-13T02:45:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.282+0000 7fe47b7b4640 1 -- 172.21.15.114:0/314924345 wait complete. 2024-04-13T02:45:02.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.283+0000 7fe47b7b4640 1 Processor -- start 2024-04-13T02:45:02.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.283+0000 7fe47b7b4640 1 -- start start 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe47b7b4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe47406d150 0x7fe4740b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe47b7b4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4740d2370 0x7fe4740b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe47b7b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 0x7fe4741ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe47b7b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe47406e120 con 0x7fe4741622c0 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe47b7b4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe47406e9f0 con 0x7fe4740d2370 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe47b7b4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe4740707f0 con 0x7fe47406d150 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 0x7fe4741ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 0x7fe4741ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37620/0 (socket says 172.21.15.114:37620) 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 -- 172.21.15.114:0/891591148 learned_addr learned my addr 172.21.15.114:0/891591148 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe478d4f640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4740d2370 0x7fe4740b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479550640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe47406d150 0x7fe4740b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 -- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe47406d150 msgr2=0x7fe4740b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe47406d150 0x7fe4740b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 -- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4740d2370 msgr2=0x7fe4740b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4740d2370 0x7fe4740b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 -- 172.21.15.114:0/891591148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47415ca00 con 0x7fe4741622c0 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.284+0000 7fe479d51640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 0x7fe4741ea520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00c7a0 tx=0x7fe46c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.285+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003b70 con 0x7fe4741622c0 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.285+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c003d30 con 0x7fe4741622c0 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.285+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47415cce0 con 0x7fe4741622c0 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.285+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00aa90 con 0x7fe4741622c0 2024-04-13T02:45:02.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.285+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4740b8540 con 0x7fe4741622c0 2024-04-13T02:45:02.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.286+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe474068c80 con 0x7fe4741622c0 2024-04-13T02:45:02.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.286+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe46c00ac30 con 0x7fe4741622c0 2024-04-13T02:45:02.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.286+0000 7fe469ffb640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe45806c8f0 0x7fe45806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.286+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe46c08b960 con 0x7fe4741622c0 2024-04-13T02:45:02.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.286+0000 7fe479550640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe45806c8f0 0x7fe45806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.287+0000 7fe479550640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe45806c8f0 0x7fe45806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe470005880 tx=0x7fe470009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.291+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe46c059740 con 0x7fe4741622c0 2024-04-13T02:45:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.467+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe47409bf70 con 0x7fe4741622c0 2024-04-13T02:45:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.467+0000 7fe469ffb640 1 -- 172.21.15.114:0/891591148 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe46c05da40 con 0x7fe4741622c0 2024-04-13T02:45:02.468 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:02.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe45806c8f0 msgr2=0x7fe45806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe45806c8f0 0x7fe45806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe470005880 tx=0x7fe470009040 comp rx=0 tx=0).stop 2024-04-13T02:45:02.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 msgr2=0x7fe4741ea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 0x7fe4741ea520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00c7a0 tx=0x7fe46c00cc60 comp rx=0 tx=0).stop 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 shutdown_connections 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4741622c0 0x7fe4741ea520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4740d2370 0x7fe4740b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe45806c8f0 0x7fe45806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 --2- 172.21.15.114:0/891591148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe47406d150 0x7fe4740b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 >> 172.21.15.114:0/891591148 conn(0x7fe4740d2750 msgr2=0x7fe47409ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 shutdown_connections 2024-04-13T02:45:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.469+0000 7fe47b7b4640 1 -- 172.21.15.114:0/891591148 wait complete. 2024-04-13T02:45:02.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.583+0000 7f20fe208640 1 Processor -- start 2024-04-13T02:45:02.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.583+0000 7f20fe208640 1 -- start start 2024-04-13T02:45:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20fe208640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20f8072860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20fe208640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f813e470 con 0x7f20f80d00c0 2024-04-13T02:45:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20fe208640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f80ccaf0 con 0x7f20f815f820 2024-04-13T02:45:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20fe208640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f20f80cdb90 con 0x7f20f813dfe0 2024-04-13T02:45:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f20f80d00c0 0x7f20f8072150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38800/0 (socket says 172.21.15.114:38800) 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f6ffd640 1 -- 172.21.15.114:0/815895814 learned_addr learned my addr 172.21.15.114:0/815895814 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f7fff640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20f8072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3210533543 0 0) 0x7f20f813e470 con 0x7f20f80d00c0 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e0003520 con 0x7f20f80d00c0 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399875275 0 0) 0x7f20f80ccaf0 con 0x7f20f815f820 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f813e470 con 0x7f20f815f820 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555241849 0 0) 0x7f20e0003520 con 0x7f20f80d00c0 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 msgr2=0x7f20f8072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20f8072860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 >> v1:172.21.15.130:6789/0 conn(0x7f20f815f820 legacy=0x7f20f815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f80ccdd0 con 0x7f20f80d00c0 2024-04-13T02:45:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f20ec001670 con 0x7f20f80d00c0 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f7fff640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20f8072860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 >> v1:172.21.15.114:6789/0 conn(0x7f20f80d00c0 legacy=0x7f20f8072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20e0003b70 0x7f20e0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e0004d40 0x7f20e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.584+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20f80cdb90 con 0x7f20e0003b70 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20e000ba70 con 0x7f20e0004d40 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f20e000bbf0 con 0x7f20f813dfe0 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f77fe640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20e0003b70 0x7f20e0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f6ffd640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f7fff640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e0004d40 0x7f20e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f77fe640 1 -- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 msgr2=0x7f20e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f77fe640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20f813dfe0 0x7f20e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f77fe640 1 -- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e0004d40 msgr2=0x7f20e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f77fe640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e0004d40 0x7f20e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.585+0000 7f20f77fe640 1 -- 172.21.15.114:0/815895814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e0003520 con 0x7f20e0003b70 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20f77fe640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20e0003b70 0x7f20e0003f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001900 tx=0x7f20e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a566ad7f5a8192a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8037070 con 0x7f20e0003b70 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e80052d0 con 0x7f20e0003b70 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20f67fc640 1 -- 172.21.15.114:0/815895814 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e80014f0 con 0x7f20e0003b70 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20fe208640 1 -- 172.21.15.114:0/815895814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20e0003b70 msgr2=0x7f20e0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20fe208640 1 --2- 172.21.15.114:0/815895814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20e0003b70 0x7f20e0003f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f20e8001900 tx=0x7f20e0005830 comp rx=0 tx=0).stop 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20f7fff640 1 -- 172.21.15.114:0/815895814 reap_dead start 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20fe208640 1 -- 172.21.15.114:0/815895814 shutdown_connections 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20fe208640 1 -- 172.21.15.114:0/815895814 >> 172.21.15.114:0/815895814 conn(0x7f20f80b2460 msgr2=0x7f20f80b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20fe208640 1 -- 172.21.15.114:0/815895814 shutdown_connections 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.586+0000 7f20fe208640 1 -- 172.21.15.114:0/815895814 wait complete. 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.587+0000 7f20fe208640 1 Processor -- start 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 -- start start 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20e0003b70 0x7f20f8158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20f8137820 0x7f20f80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 0x7f20f813a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20f80cd670 con 0x7f20f80cf4f0 2024-04-13T02:45:02.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20f80cd390 con 0x7f20f8137820 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20fe208640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f20f8072860 con 0x7f20e0003b70 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 0x7f20f813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 0x7f20f813a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37646/0 (socket says 172.21.15.114:37646) 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.588+0000 7f20f7fff640 1 -- 172.21.15.114:0/3944013481 learned_addr learned my addr 172.21.15.114:0/3944013481 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f6ffd640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20f8137820 0x7f20f80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f77fe640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20e0003b70 0x7f20f8158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f7fff640 1 -- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20e0003b70 msgr2=0x7f20f8158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f7fff640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20e0003b70 0x7f20f8158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f7fff640 1 -- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20f8137820 msgr2=0x7f20f80cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f7fff640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20f8137820 0x7f20f80cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f7fff640 1 -- 172.21.15.114:0/3944013481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f8158bd0 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f6ffd640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20f8137820 0x7f20f80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20f7fff640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 0x7f20f813a440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ed0 tx=0x7f20f000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f000fe10 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f0003990 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f81352e0 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0003d80 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.589+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81358a0 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.590+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f8068c80 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.591+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20f0004020 con 0x7f20f80cf4f0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.591+0000 7f20dffff640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f20e406c920 0x7f20e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.591+0000 7f20f77fe640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f20e406c920 0x7f20e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.591+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f20f008c600 con 0x7f20f80cf4f0 2024-04-13T02:45:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.591+0000 7f20f77fe640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f20e406c920 0x7f20e406ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f20e8034000 tx=0x7f20e8031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.595+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20f0019030 con 0x7f20f80cf4f0 2024-04-13T02:45:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.769+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f20f80701b0 con 0x7f20f80cf4f0 2024-04-13T02:45:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.769+0000 7f20dffff640 1 -- 172.21.15.114:0/3944013481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f20f0010040 con 0x7f20f80cf4f0 2024-04-13T02:45:02.770 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:02.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f20e406c920 msgr2=0x7f20e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f20e406c920 0x7f20e406ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f20e8034000 tx=0x7f20e8031000 comp rx=0 tx=0).stop 2024-04-13T02:45:02.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 msgr2=0x7f20f813a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 0x7f20f813a440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ed0 tx=0x7f20f000f580 comp rx=0 tx=0).stop 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 shutdown_connections 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20f80cf4f0 0x7f20f813a440 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20f8137820 0x7f20f80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f20e406c920 0x7f20e406ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 --2- 172.21.15.114:0/3944013481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20e0003b70 0x7f20f8158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.771+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 >> 172.21.15.114:0/3944013481 conn(0x7f20f80b2460 msgr2=0x7f20f815dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.772+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 shutdown_connections 2024-04-13T02:45:02.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.772+0000 7f20fe208640 1 -- 172.21.15.114:0/3944013481 wait complete. 2024-04-13T02:45:02.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.885+0000 7fd72dfc8640 1 Processor -- start 2024-04-13T02:45:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.885+0000 7fd72dfc8640 1 -- start start 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd72dfc8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd728145170 0x7fd7280cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd72dfc8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7280b4410 con 0x7fd7280ce070 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd72dfc8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7280b46f0 con 0x7fd72806f260 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd72dfc8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd728145550 con 0x7fd728145170 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd7277fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd728145170 0x7fd7280cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd726ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd7280ce070 0x7fd7280b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38806/0 (socket says 172.21.15.114:38806) 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd726ffd640 1 -- 172.21.15.114:0/2306323380 learned_addr learned my addr 172.21.15.114:0/2306323380 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd7277fe640 1 -- 172.21.15.114:0/2306323380 >> v1:172.21.15.130:6789/0 conn(0x7fd72806f260 legacy=0x7fd72806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd7277fe640 1 -- 172.21.15.114:0/2306323380 >> v1:172.21.15.114:6789/0 conn(0x7fd7280ce070 legacy=0x7fd7280b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.886+0000 7fd7267fc640 1 -- 172.21.15.114:0/2306323380 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038389689 0 0) 0x7fd7280b4410 con 0x7fd7280ce070 2024-04-13T02:45:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.887+0000 7fd7277fe640 1 -- 172.21.15.114:0/2306323380 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7280b49d0 con 0x7fd728145170 2024-04-13T02:45:02.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.887+0000 7fd7277fe640 1 --2- 172.21.15.114:0/2306323380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd728145170 0x7fd7280cdb30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd7281456d0 tx=0x7fd71802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2392608b2fb7b0f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.887+0000 7fd7267fc640 1 -- 172.21.15.114:0/2306323380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718035020 con 0x7fd728145170 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.887+0000 7fd7267fc640 1 -- 172.21.15.114:0/2306323380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd718031830 con 0x7fd728145170 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.887+0000 7fd7267fc640 1 -- 172.21.15.114:0/2306323380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718031c00 con 0x7fd728145170 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2306323380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd728145170 msgr2=0x7fd7280cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2306323380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd728145170 0x7fd7280cdb30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd7281456d0 tx=0x7fd71802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2306323380 shutdown_connections 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2306323380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd728145170 0x7fd7280cdb30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2306323380 >> 172.21.15.114:0/2306323380 conn(0x7fd7280b2460 msgr2=0x7fd7280b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2306323380 shutdown_connections 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.888+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2306323380 wait complete. 2024-04-13T02:45:02.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.889+0000 7fd72dfc8640 1 Processor -- start 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.889+0000 7fd72dfc8640 1 -- start start 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd72dfc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 0x7fd72815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd72dfc8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7280ce070 0x7fd7281416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd72dfc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd728145170 0x7fd7280ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd72dfc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280b5bc0 con 0x7fd72806f260 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd72dfc8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280b4f90 con 0x7fd7280ce070 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd72dfc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd7280b4030 con 0x7fd728145170 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 0x7fd72815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 0x7fd72815b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37672/0 (socket says 172.21.15.114:37672) 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 -- 172.21.15.114:0/2139599704 learned_addr learned my addr 172.21.15.114:0/2139599704 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd726ffd640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7280ce070 0x7fd7281416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd727fff640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd728145170 0x7fd7280ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 -- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd728145170 msgr2=0x7fd7280ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd728145170 0x7fd7280ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 -- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7280ce070 msgr2=0x7fd7281416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7280ce070 0x7fd7281416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 -- 172.21.15.114:0/2139599704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72813e8e0 con 0x7fd72806f260 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd726ffd640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7280ce070 0x7fd7281416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd727fff640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd728145170 0x7fd7280ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.890+0000 7fd7277fe640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 0x7fd72815b1f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd718034040 tx=0x7fd7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.891+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718004230 con 0x7fd72806f260 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.891+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7180043d0 con 0x7fd72806f260 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.891+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7280af0c0 con 0x7fd72806f260 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.891+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71803b8b0 con 0x7fd72806f260 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.891+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7280af3a0 con 0x7fd72806f260 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.892+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd728068c80 con 0x7fd72806f260 2024-04-13T02:45:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.892+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd71804c060 con 0x7fd72806f260 2024-04-13T02:45:02.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.892+0000 7fd70ffff640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd71406c8f0 0x7fd71406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:02.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.893+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd7180ad660 con 0x7fd72806f260 2024-04-13T02:45:02.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.893+0000 7fd726ffd640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd71406c8f0 0x7fd71406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:02.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.893+0000 7fd726ffd640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd71406c8f0 0x7fd71406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd72813db40 tx=0x7fd71c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:02.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:02.897+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd718040070 con 0x7fd72806f260 2024-04-13T02:45:03.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.072+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7280b3770 con 0x7fd72806f260 2024-04-13T02:45:03.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.073+0000 7fd70ffff640 1 -- 172.21.15.114:0/2139599704 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd71807bb20 con 0x7fd72806f260 2024-04-13T02:45:03.074 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd71406c8f0 msgr2=0x7fd71406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd71406c8f0 0x7fd71406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd72813db40 tx=0x7fd71c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 msgr2=0x7fd72815b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 0x7fd72815b1f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd718034040 tx=0x7fd7180046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 shutdown_connections 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd71406c8f0 0x7fd71406edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd728145170 0x7fd7280ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7280ce070 0x7fd7281416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 --2- 172.21.15.114:0/2139599704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd72806f260 0x7fd72815b1f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 >> 172.21.15.114:0/2139599704 conn(0x7fd7280b2460 msgr2=0x7fd72806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 shutdown_connections 2024-04-13T02:45:03.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.075+0000 7fd72dfc8640 1 -- 172.21.15.114:0/2139599704 wait complete. 2024-04-13T02:45:03.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.186+0000 7f94f1d55640 1 Processor -- start 2024-04-13T02:45:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.186+0000 7f94f1d55640 1 -- start start 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94f1d55640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94ec0ce9b0 0x7f94ec09b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94f1d55640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec0d1030 con 0x7f94ec06d8f0 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94f1d55640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec0d1310 con 0x7f94ec06d510 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94f1d55640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec09be50 con 0x7f94ec0ce9b0 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94ebfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94ec0ce9b0 0x7f94ec09b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94eaffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f94ec06d8f0 0x7f94ec0ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38816/0 (socket says 172.21.15.114:38816) 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94eaffd640 1 -- 172.21.15.114:0/405959570 learned_addr learned my addr 172.21.15.114:0/405959570 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94ebfff640 1 -- 172.21.15.114:0/405959570 >> v1:172.21.15.130:6789/0 conn(0x7f94ec06d510 legacy=0x7f94ec0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94ebfff640 1 -- 172.21.15.114:0/405959570 >> v1:172.21.15.114:6789/0 conn(0x7f94ec06d8f0 legacy=0x7f94ec0ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94ea7fc640 1 -- 172.21.15.114:0/405959570 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021351189 0 0) 0x7f94ec0d1030 con 0x7f94ec06d8f0 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.187+0000 7f94ebfff640 1 -- 172.21.15.114:0/405959570 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0d15f0 con 0x7f94ec0ce9b0 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.188+0000 7f94ebfff640 1 --2- 172.21.15.114:0/405959570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec0ce9b0 0x7f94ec09b910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009d90 tx=0x7f94e402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83800a9c08733786 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.188+0000 7f94ea7fc640 1 -- 172.21.15.114:0/405959570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4039070 con 0x7f94ec0ce9b0 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.188+0000 7f94ea7fc640 1 -- 172.21.15.114:0/405959570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e402cd00 con 0x7f94ec0ce9b0 2024-04-13T02:45:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.188+0000 7f94ea7fc640 1 -- 172.21.15.114:0/405959570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4034660 con 0x7f94ec0ce9b0 2024-04-13T02:45:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 -- 172.21.15.114:0/405959570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec0ce9b0 msgr2=0x7f94ec09b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 --2- 172.21.15.114:0/405959570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec0ce9b0 0x7f94ec09b910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009d90 tx=0x7f94e402bf50 comp rx=0 tx=0).stop 2024-04-13T02:45:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 -- 172.21.15.114:0/405959570 shutdown_connections 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 --2- 172.21.15.114:0/405959570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec0ce9b0 0x7f94ec09b910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 -- 172.21.15.114:0/405959570 >> 172.21.15.114:0/405959570 conn(0x7f94ec0d27c0 msgr2=0x7f94ec0d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 -- 172.21.15.114:0/405959570 shutdown_connections 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.189+0000 7f94f1d55640 1 -- 172.21.15.114:0/405959570 wait complete. 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.190+0000 7f94f1d55640 1 Processor -- start 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.190+0000 7f94f1d55640 1 -- start start 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94f1d55640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ec06d510 0x7f94ec1f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94f1d55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 0x7f94ec1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94f1d55640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ec0ce9b0 0x7f94ec0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94f1d55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0d20d0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94f1d55640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0d1bb0 con 0x7f94ec06d510 2024-04-13T02:45:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94f1d55640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0d2250 con 0x7f94ec0ce9b0 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 0x7f94ec1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 0x7f94ec1f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37700/0 (socket says 172.21.15.114:37700) 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 -- 172.21.15.114:0/2527151244 learned_addr learned my addr 172.21.15.114:0/2527151244 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eb7fe640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ec06d510 0x7f94ec1f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94ebfff640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ec0ce9b0 0x7f94ec0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 -- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ec0ce9b0 msgr2=0x7f94ec0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ec0ce9b0 0x7f94ec0c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 -- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ec06d510 msgr2=0x7f94ec1f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ec06d510 0x7f94ec1f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eaffd640 1 -- 172.21.15.114:0/2527151244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0b1cb0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.191+0000 7f94eb7fe640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ec06d510 0x7f94ec1f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.192+0000 7f94eaffd640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 0x7f94ec1f3dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f94e000c3c0 tx=0x7f94e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.192+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e00074e0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.192+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e00047e0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.192+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec1f4310 con 0x7f94ec06d8f0 2024-04-13T02:45:03.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.192+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004bd0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.192+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec0b02b0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.193+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec068c80 con 0x7f94ec06d8f0 2024-04-13T02:45:03.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.193+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94e0011070 con 0x7f94ec06d8f0 2024-04-13T02:45:03.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.193+0000 7f94d3fff640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f94d806c8f0 0x7f94d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.194+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f94e008b670 con 0x7f94ec06d8f0 2024-04-13T02:45:03.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.194+0000 7f94eb7fe640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f94d806c8f0 0x7f94d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.194+0000 7f94eb7fe640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f94d806c8f0 0x7f94d806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007fd0 tx=0x7f94dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.198+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94ec0b1cb0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.379+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94ec06f3a0 con 0x7f94ec06d8f0 2024-04-13T02:45:03.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.380+0000 7f94d3fff640 1 -- 172.21.15.114:0/2527151244 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f94e000e280 con 0x7f94ec06d8f0 2024-04-13T02:45:03.381 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:03.381 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f94d806c8f0 msgr2=0x7f94d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f94d806c8f0 0x7f94d806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007fd0 tx=0x7f94dc009040 comp rx=0 tx=0).stop 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 msgr2=0x7f94ec1f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 0x7f94ec1f3dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f94e000c3c0 tx=0x7f94e000c880 comp rx=0 tx=0).stop 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 shutdown_connections 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f94d806c8f0 0x7f94d806edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ec0ce9b0 0x7f94ec0c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94ec06d8f0 0x7f94ec1f3dd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 --2- 172.21.15.114:0/2527151244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ec06d510 0x7f94ec1f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 >> 172.21.15.114:0/2527151244 conn(0x7f94ec0d27c0 msgr2=0x7f94ec161c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 shutdown_connections 2024-04-13T02:45:03.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.382+0000 7f94f1d55640 1 -- 172.21.15.114:0/2527151244 wait complete. 2024-04-13T02:45:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:03.394 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:03.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.496+0000 7f255c755640 1 Processor -- start 2024-04-13T02:45:03.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.496+0000 7f255c755640 1 -- start start 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255c755640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255409ac00 0x7f255415d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255c755640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25540b5a10 con 0x7f255415c750 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255c755640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255409b0e0 con 0x7f25540b6990 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255c755640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f255409b3c0 con 0x7f255409ac00 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255acf2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255409ac00 0x7f255415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255a4f1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f255415c750 0x7f25540b6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38832/0 (socket says 172.21.15.114:38832) 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255a4f1640 1 -- 172.21.15.114:0/4222364116 learned_addr learned my addr 172.21.15.114:0/4222364116 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:03.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255acf2640 1 -- 172.21.15.114:0/4222364116 >> v1:172.21.15.130:6789/0 conn(0x7f25540b6990 legacy=0x7f255415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:03.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255acf2640 1 -- 172.21.15.114:0/4222364116 >> v1:172.21.15.114:6789/0 conn(0x7f255415c750 legacy=0x7f25540b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f255acf2640 1 -- 172.21.15.114:0/4222364116 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255409b6a0 con 0x7f255409ac00 2024-04-13T02:45:03.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.497+0000 7f25594ef640 1 -- 172.21.15.114:0/4222364116 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209258715 0 0) 0x7f25540b5a10 con 0x7f255415c750 2024-04-13T02:45:03.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.498+0000 7f255acf2640 1 --2- 172.21.15.114:0/4222364116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f255415d980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f254c009d90 tx=0x7f254c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb311a981cd38a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.498+0000 7f25594ef640 1 -- 172.21.15.114:0/4222364116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c039070 con 0x7f255409ac00 2024-04-13T02:45:03.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.498+0000 7f25594ef640 1 -- 172.21.15.114:0/4222364116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254c02cc60 con 0x7f255409ac00 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.498+0000 7f25594ef640 1 -- 172.21.15.114:0/4222364116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c034660 con 0x7f255409ac00 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 -- 172.21.15.114:0/4222364116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 msgr2=0x7f255415d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 --2- 172.21.15.114:0/4222364116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f255415d980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f254c009d90 tx=0x7f254c02beb0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 -- 172.21.15.114:0/4222364116 shutdown_connections 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 --2- 172.21.15.114:0/4222364116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f255415d980 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 -- 172.21.15.114:0/4222364116 >> 172.21.15.114:0/4222364116 conn(0x7f25540b7eb0 msgr2=0x7f25540b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 -- 172.21.15.114:0/4222364116 shutdown_connections 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.499+0000 7f255c755640 1 -- 172.21.15.114:0/4222364116 wait complete. 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 Processor -- start 2024-04-13T02:45:03.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 -- start start 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f2554141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25540b6990 0x7f2554146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255415c750 0x7f255406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f255415cb30 con 0x7f255409ac00 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f255409bc60 con 0x7f25540b6990 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.500+0000 7f255c755640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f255415ccb0 con 0x7f255415c750 2024-04-13T02:45:03.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f2554141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f2554141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37712/0 (socket says 172.21.15.114:37712) 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 -- 172.21.15.114:0/585200820 learned_addr learned my addr 172.21.15.114:0/585200820 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f2559cf0640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25540b6990 0x7f2554146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255acf2640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255415c750 0x7f255406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 -- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255415c750 msgr2=0x7f255406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255415c750 0x7f255406e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 -- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25540b6990 msgr2=0x7f2554146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25540b6990 0x7f2554146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 -- 172.21.15.114:0/585200820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541478c0 con 0x7f255409ac00 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255acf2640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255415c750 0x7f255406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255a4f1640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f2554141170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f255000c460 tx=0x7f255000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550018070 con 0x7f255409ac00 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2550007500 con 0x7f255409ac00 2024-04-13T02:45:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2554147ba0 con 0x7f255409ac00 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550004a20 con 0x7f255409ac00 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.501+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255406d9f0 con 0x7f255409ac00 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.502+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2554068c80 con 0x7f255409ac00 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.503+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f255001b070 con 0x7f255409ac00 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.503+0000 7f254affd640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f253806c8f0 0x7f253806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.503+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f255008ad50 con 0x7f255409ac00 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.503+0000 7f2559cf0640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f253806c8f0 0x7f253806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.503+0000 7f2559cf0640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f253806c8f0 0x7f253806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2544007fd0 tx=0x7f2544009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.507+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f255008e030 con 0x7f255409ac00 2024-04-13T02:45:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.683+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2554158390 con 0x7f255409ac00 2024-04-13T02:45:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.684+0000 7f254affd640 1 -- 172.21.15.114:0/585200820 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2550059210 con 0x7f255409ac00 2024-04-13T02:45:03.685 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f253806c8f0 msgr2=0x7f253806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f253806c8f0 0x7f253806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2544007fd0 tx=0x7f2544009040 comp rx=0 tx=0).stop 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 msgr2=0x7f2554141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f2554141170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f255000c460 tx=0x7f255000c920 comp rx=0 tx=0).stop 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 shutdown_connections 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f253806c8f0 0x7f253806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f255415c750 0x7f255406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25540b6990 0x7f2554146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 --2- 172.21.15.114:0/585200820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f255409ac00 0x7f2554141170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 >> 172.21.15.114:0/585200820 conn(0x7f25540b7eb0 msgr2=0x7f25540b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 shutdown_connections 2024-04-13T02:45:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.686+0000 7f255c755640 1 -- 172.21.15.114:0/585200820 wait complete. 2024-04-13T02:45:03.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.799+0000 7f343391e640 1 Processor -- start 2024-04-13T02:45:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.800+0000 7f343391e640 1 -- start start 2024-04-13T02:45:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.800+0000 7f343391e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c15ecc0 0x7f342c0d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.800+0000 7f343391e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f342c0d3270 0x7f342c0b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.800+0000 7f343391e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c0ba4d0 con 0x7f342c0b3720 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.800+0000 7f343391e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f342c15f0a0 con 0x7f342c0d3270 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f343391e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f342c0ba280 con 0x7f342c15ecc0 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f34316ba640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c15ecc0 0x7f342c0d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3430eb9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f342c0d3270 0x7f342c0b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f34316ba640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c15ecc0 0x7f342c0d2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:37328/0 (socket says 172.21.15.114:37328) 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f34316ba640 1 -- 172.21.15.114:0/3448602227 learned_addr learned my addr 172.21.15.114:0/3448602227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3430eb9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f342c0d3270 0x7f342c0b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:51930/0 (socket says 172.21.15.114:51930) 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3431ebb640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f342c0b3720 0x7f342c0cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:39840/0 (socket says 172.21.15.114:39840) 2024-04-13T02:45:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3430eb9640 1 -- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c15ecc0 msgr2=0x7f342c0d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3430eb9640 1 --2- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c15ecc0 0x7f342c0d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3430eb9640 1 -- 172.21.15.114:0/3448602227 >> v1:172.21.15.130:6789/0 conn(0x7f342c0b3720 legacy=0x7f342c0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.801+0000 7f3430eb9640 1 -- 172.21.15.114:0/3448602227 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c0ba7b0 con 0x7f342c0d3270 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.802+0000 7f3430eb9640 1 --2- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0d3270 0x7f342c0b95f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f341c0097a0 tx=0x7f341c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2a055f6ae58c12b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.802+0000 7f3423fff640 1 -- 172.21.15.114:0/3448602227 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c035020 con 0x7f342c0d3270 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.802+0000 7f3423fff640 1 -- 172.21.15.114:0/3448602227 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341c031830 con 0x7f342c0d3270 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.802+0000 7f3423fff640 1 -- 172.21.15.114:0/3448602227 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c031c00 con 0x7f342c0d3270 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 -- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0d3270 msgr2=0x7f342c0b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 --2- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0d3270 0x7f342c0b95f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f341c0097a0 tx=0x7f341c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 -- 172.21.15.114:0/3448602227 shutdown_connections 2024-04-13T02:45:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 --2- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0d3270 0x7f342c0b95f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 --2- 172.21.15.114:0/3448602227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c15ecc0 0x7f342c0d2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 -- 172.21.15.114:0/3448602227 >> 172.21.15.114:0/3448602227 conn(0x7f342c073480 msgr2=0x7f342c073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 -- 172.21.15.114:0/3448602227 shutdown_connections 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.803+0000 7f343391e640 1 -- 172.21.15.114:0/3448602227 wait complete. 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.804+0000 7f343391e640 1 Processor -- start 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.804+0000 7f343391e640 1 -- start start 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f343391e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0b3720 0x7f342c0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f343391e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c0d3270 0x7f342c15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f343391e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 0x7f342c161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f343391e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f342c0b8aa0 con 0x7f342c15ecc0 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f343391e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f342c0b90d0 con 0x7f342c0b3720 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f343391e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f342c0cfdb0 con 0x7f342c0d3270 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 0x7f342c161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 0x7f342c161850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37716/0 (socket says 172.21.15.114:37716) 2024-04-13T02:45:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 -- 172.21.15.114:0/2837281559 learned_addr learned my addr 172.21.15.114:0/2837281559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f34316ba640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0b3720 0x7f342c0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3430eb9640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c0d3270 0x7f342c15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 -- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c0d3270 msgr2=0x7f342c15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c0d3270 0x7f342c15fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 -- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0b3720 msgr2=0x7f342c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0b3720 0x7f342c0c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 -- 172.21.15.114:0/2837281559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c1607b0 con 0x7f342c15ecc0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3431ebb640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 0x7f342c161850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f342800c400 tx=0x7f342800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.805+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34280074e0 con 0x7f342c15ecc0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.806+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3428007680 con 0x7f342c15ecc0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.806+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34280049e0 con 0x7f342c15ecc0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.806+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342c160a90 con 0x7f342c15ecc0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.806+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342c161050 con 0x7f342c15ecc0 2024-04-13T02:45:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.807+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342c068c80 con 0x7f342c15ecc0 2024-04-13T02:45:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.807+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f342801a020 con 0x7f342c15ecc0 2024-04-13T02:45:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.807+0000 7f3421ffb640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f341006c8f0 0x7f341006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.808+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f342808b290 con 0x7f342c15ecc0 2024-04-13T02:45:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.808+0000 7f34316ba640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f341006c8f0 0x7f341006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.808+0000 7f34316ba640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f341006c8f0 0x7f341006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3424011340 tx=0x7f342400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:03.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.812+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3428058ff0 con 0x7f342c15ecc0 2024-04-13T02:45:03.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:45:03.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:45:03.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.988+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f342c0b48b0 con 0x7f342c15ecc0 2024-04-13T02:45:03.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.989+0000 7f3421ffb640 1 -- 172.21.15.114:0/2837281559 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f342805d2f0 con 0x7f342c15ecc0 2024-04-13T02:45:03.990 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f341006c8f0 msgr2=0x7f341006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f341006c8f0 0x7f341006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3424011340 tx=0x7f342400b040 comp rx=0 tx=0).stop 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 msgr2=0x7f342c161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 0x7f342c161850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f342800c400 tx=0x7f342800c8c0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 shutdown_connections 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342c15ecc0 0x7f342c161850 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f341006c8f0 0x7f341006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f342c0d3270 0x7f342c15fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 --2- 172.21.15.114:0/2837281559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f342c0b3720 0x7f342c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 >> 172.21.15.114:0/2837281559 conn(0x7f342c073480 msgr2=0x7f342c0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 shutdown_connections 2024-04-13T02:45:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:03.991+0000 7f343391e640 1 -- 172.21.15.114:0/2837281559 wait complete. 2024-04-13T02:45:04.003 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:04.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.150+0000 7fdbb56d5640 1 Processor -- start 2024-04-13T02:45:04.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.150+0000 7fdbb56d5640 1 -- start start 2024-04-13T02:45:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbb56d5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbb00cf9d0 0x7fdbb015f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbb56d5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdbb00d2720 0x7fdbb00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbb56d5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb00d4950 con 0x7fdbb00d1aa0 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbb56d5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb015f5e0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbb56d5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb015f8c0 con 0x7fdbb00d2720 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaeffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbb00cf9d0 0x7fdbb015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaf7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdbb00d1aa0 0x7fdbb00d4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38834/0 (socket says 172.21.15.114:38834) 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaf7fe640 1 -- 172.21.15.114:0/3263983341 learned_addr learned my addr 172.21.15.114:0/3263983341 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdba7fff640 1 --2- 172.21.15.114:0/3263983341 >> v2:172.21.15.130:3300/0 conn(0x7fdbb00d2720 0x7fdbb00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaeffd640 1 -- 172.21.15.114:0/3263983341 >> v2:172.21.15.130:3300/0 conn(0x7fdbb00d2720 msgr2=0x7fdbb00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaeffd640 1 --2- 172.21.15.114:0/3263983341 >> v2:172.21.15.130:3300/0 conn(0x7fdbb00d2720 0x7fdbb00b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaeffd640 1 -- 172.21.15.114:0/3263983341 >> v1:172.21.15.114:6789/0 conn(0x7fdbb00d1aa0 legacy=0x7fdbb00d4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbaeffd640 1 -- 172.21.15.114:0/3263983341 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb015fba0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdbae7fc640 1 -- 172.21.15.114:0/3263983341 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445133347 0 0) 0x7fdbb00d4950 con 0x7fdbb00d1aa0 2024-04-13T02:45:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.151+0000 7fdba7fff640 1 --2- 172.21.15.114:0/3263983341 >> v2:172.21.15.130:3300/0 conn(0x7fdbb00d2720 0x7fdbb00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:04.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.152+0000 7fdbaeffd640 1 --2- 172.21.15.114:0/3263983341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb015f000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00d5bf0 tx=0x7fdba002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2f75c8f8fea929 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.152+0000 7fdbae7fc640 1 -- 172.21.15.114:0/3263983341 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0035020 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.152+0000 7fdbae7fc640 1 -- 172.21.15.114:0/3263983341 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba0031830 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.152+0000 7fdbae7fc640 1 -- 172.21.15.114:0/3263983341 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0031c00 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 -- 172.21.15.114:0/3263983341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 msgr2=0x7fdbb015f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/3263983341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb015f000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00d5bf0 tx=0x7fdba002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 -- 172.21.15.114:0/3263983341 shutdown_connections 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/3263983341 >> v2:172.21.15.130:3300/0 conn(0x7fdbb00d2720 0x7fdbb00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/3263983341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb015f000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 -- 172.21.15.114:0/3263983341 >> 172.21.15.114:0/3263983341 conn(0x7fdbb0073480 msgr2=0x7fdbb0073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 -- 172.21.15.114:0/3263983341 shutdown_connections 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.153+0000 7fdbb56d5640 1 -- 172.21.15.114:0/3263983341 wait complete. 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.154+0000 7fdbb56d5640 1 Processor -- start 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.154+0000 7fdbb56d5640 1 -- start start 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.154+0000 7fdbb56d5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb00c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.154+0000 7fdbb56d5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb00d1aa0 0x7fdbb01f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbb56d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb00d2720 0x7fdbb00b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbb56d5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb00b41c0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbb56d5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb00cfdb0 con 0x7fdbb00d2720 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbb56d5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb00d2bd0 con 0x7fdbb00d1aa0 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb00c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb00c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37728/0 (socket says 172.21.15.114:37728) 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 -- 172.21.15.114:0/2132676147 learned_addr learned my addr 172.21.15.114:0/2132676147 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaf7fe640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb00d2720 0x7fdbb00b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 -- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb00d1aa0 msgr2=0x7fdbb01f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdba7fff640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb00d1aa0 0x7fdbb01f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb00d1aa0 0x7fdbb01f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 -- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb00d2720 msgr2=0x7fdbb00b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb00d2720 0x7fdbb00b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 -- 172.21.15.114:0/2132676147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb00cbcc0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaf7fe640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb00d2720 0x7fdbb00b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbaeffd640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb00c87c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdba0000c00 tx=0x7fdba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0041070 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba0004230 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0035040 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb00cbf30 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.155+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb00b5bd0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.156+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb0068c80 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.157+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdba0038020 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.157+0000 7fdba77fe640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb9006c920 0x7fdb9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.157+0000 7fdba7fff640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb9006c920 0x7fdb9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.157+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdba00ad5c0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.158+0000 7fdba7fff640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb9006c920 0x7fdb9006ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00b7df0 tx=0x7fdb98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.162+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdba007b9f0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.342+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdbb00b74d0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.342+0000 7fdba77fe640 1 -- 172.21.15.114:0/2132676147 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fdba007b2f0 con 0x7fdbb00cf9d0 2024-04-13T02:45:04.343 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb9006c920 msgr2=0x7fdb9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb9006c920 0x7fdb9006ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00b7df0 tx=0x7fdb98008040 comp rx=0 tx=0).stop 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 msgr2=0x7fdbb00c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb00c87c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdba0000c00 tx=0x7fdba00046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 shutdown_connections 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdbb00d2720 0x7fdbb00b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb9006c920 0x7fdb9006ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdbb00d1aa0 0x7fdbb01f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 --2- 172.21.15.114:0/2132676147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb00cf9d0 0x7fdbb00c87c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 >> 172.21.15.114:0/2132676147 conn(0x7fdbb0073480 msgr2=0x7fdbb0073860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:04.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 shutdown_connections 2024-04-13T02:45:04.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.345+0000 7fdbb56d5640 1 -- 172.21.15.114:0/2132676147 wait complete. 2024-04-13T02:45:04.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:04.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.456+0000 7f0d2dd1e640 1 Processor -- start 2024-04-13T02:45:04.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.456+0000 7f0d2dd1e640 1 -- start start 2024-04-13T02:45:04.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.457+0000 7f0d2dd1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d28070210 0x7f0d280b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.457+0000 7f0d2dd1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d280b5020 0x7f0d2815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.457+0000 7f0d2dd1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2806f940 con 0x7f0d2815b6d0 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.457+0000 7f0d2dd1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2806e8a0 con 0x7f0d28070210 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.457+0000 7f0d2dd1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2806eb80 con 0x7f0d280b5020 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d26ffd640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0d28070210 0x7f0d280b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d280b5020 0x7f0d2815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d277fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0d2815b6d0 0x7f0d280cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:39842/0 (socket says 172.21.15.114:39842) 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d277fe640 1 -- 172.21.15.114:0/1139136192 learned_addr learned my addr 172.21.15.114:0/1139136192 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d26ffd640 1 -- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d280b5020 msgr2=0x7f0d2815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d26ffd640 1 --2- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d280b5020 0x7f0d2815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d26ffd640 1 -- 172.21.15.114:0/1139136192 >> v1:172.21.15.130:6789/0 conn(0x7f0d2815b6d0 legacy=0x7f0d280cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d26ffd640 1 -- 172.21.15.114:0/1139136192 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2806ee60 con 0x7f0d28070210 2024-04-13T02:45:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.458+0000 7f0d267fc640 1 -- 172.21.15.114:0/1139136192 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052118796 0 0) 0x7f0d2806f940 con 0x7f0d2815b6d0 2024-04-13T02:45:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d26ffd640 1 --2- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d28070210 0x7f0d280b4ae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0097a0 tx=0x7f0d1c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bcdea41a8663db9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d267fc640 1 -- 172.21.15.114:0/1139136192 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c035020 con 0x7f0d28070210 2024-04-13T02:45:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d267fc640 1 -- 172.21.15.114:0/1139136192 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1c031830 con 0x7f0d28070210 2024-04-13T02:45:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d267fc640 1 -- 172.21.15.114:0/1139136192 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c031c00 con 0x7f0d28070210 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d28070210 msgr2=0x7f0d280b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d28070210 0x7f0d280b4ae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0097a0 tx=0x7f0d1c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1139136192 shutdown_connections 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d280b5020 0x7f0d2815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1139136192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d28070210 0x7f0d280b4ae0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1139136192 >> 172.21.15.114:0/1139136192 conn(0x7f0d280b27b0 msgr2=0x7f0d280b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1139136192 shutdown_connections 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.459+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1139136192 wait complete. 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 Processor -- start 2024-04-13T02:45:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 -- start start 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d28070210 0x7f0d281514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d280b5020 0x7f0d2815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 0x7f0d2815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280ce420 con 0x7f0d2815b6d0 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2806f420 con 0x7f0d280b5020 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.461+0000 7f0d2dd1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2815bff0 con 0x7f0d28070210 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 0x7f0d2815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 0x7f0d2815c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37744/0 (socket says 172.21.15.114:37744) 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 -- 172.21.15.114:0/1866104435 learned_addr learned my addr 172.21.15.114:0/1866104435 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d277fe640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d28070210 0x7f0d281514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d26ffd640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d280b5020 0x7f0d2815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 -- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d28070210 msgr2=0x7f0d281514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d28070210 0x7f0d281514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 -- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d280b5020 msgr2=0x7f0d2815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d280b5020 0x7f0d2815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 -- 172.21.15.114:0/1866104435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d280c9b50 con 0x7f0d2815b6d0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d27fff640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 0x7f0d2815c900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000efc0 tx=0x7f0d2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20018020 con 0x7f0d2815b6d0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d20014480 con 0x7f0d2815b6d0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d280c67e0 con 0x7f0d2815b6d0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20014870 con 0x7f0d2815b6d0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.462+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d280c6da0 con 0x7f0d2815b6d0 2024-04-13T02:45:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.463+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d280c9d20 con 0x7f0d2815b6d0 2024-04-13T02:45:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.464+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d20005d10 con 0x7f0d2815b6d0 2024-04-13T02:45:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.464+0000 7f0d0ffff640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0d1406c8f0 0x7f0d1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.464+0000 7f0d277fe640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0d1406c8f0 0x7f0d1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.464+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0d2008c5f0 con 0x7f0d2815b6d0 2024-04-13T02:45:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.465+0000 7f0d277fe640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0d1406c8f0 0x7f0d1406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d18007fd0 tx=0x7f0d18007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.468+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d20022070 con 0x7f0d2815b6d0 2024-04-13T02:45:04.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.645+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d280d0560 con 0x7f0d2815b6d0 2024-04-13T02:45:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.646+0000 7f0d0ffff640 1 -- 172.21.15.114:0/1866104435 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f0d20010040 con 0x7f0d2815b6d0 2024-04-13T02:45:04.647 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:04.647 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:04.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0d1406c8f0 msgr2=0x7f0d1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0d1406c8f0 0x7f0d1406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d18007fd0 tx=0x7f0d18007de0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 msgr2=0x7f0d2815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 0x7f0d2815c900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000efc0 tx=0x7f0d2000c490 comp rx=0 tx=0).stop 2024-04-13T02:45:04.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 shutdown_connections 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d2815b6d0 0x7f0d2815c900 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d280b5020 0x7f0d2815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0d1406c8f0 0x7f0d1406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 --2- 172.21.15.114:0/1866104435 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0d28070210 0x7f0d281514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 >> 172.21.15.114:0/1866104435 conn(0x7f0d280b27b0 msgr2=0x7f0d280cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 shutdown_connections 2024-04-13T02:45:04.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.648+0000 7f0d2dd1e640 1 -- 172.21.15.114:0/1866104435 wait complete. 2024-04-13T02:45:04.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:04.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.764+0000 7f71167bb640 1 Processor -- start 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.764+0000 7f71167bb640 1 -- start start 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f71167bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71101591c0 0x7f711015f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f71167bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f711009ace0 0x7f71100b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f71167bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711015ffe0 con 0x7f711015f5a0 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f71167bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f71101595a0 con 0x7f71101591c0 2024-04-13T02:45:04.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f71167bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7110160220 con 0x7f711009ace0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71101591c0 0x7f711015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f711015f5a0 0x7f711006d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38844/0 (socket says 172.21.15.114:38844) 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710f7fe640 1 -- 172.21.15.114:0/2056776278 learned_addr learned my addr 172.21.15.114:0/2056776278 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710ffff640 1 -- 172.21.15.114:0/2056776278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f711009ace0 msgr2=0x7f71100b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710ffff640 1 --2- 172.21.15.114:0/2056776278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f711009ace0 0x7f71100b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710ffff640 1 -- 172.21.15.114:0/2056776278 >> v1:172.21.15.114:6789/0 conn(0x7f711015f5a0 legacy=0x7f711006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710ffff640 1 -- 172.21.15.114:0/2056776278 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711015fa20 con 0x7f71101591c0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.765+0000 7f710effd640 1 -- 172.21.15.114:0/2056776278 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180741200 0 0) 0x7f711015ffe0 con 0x7f711015f5a0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.766+0000 7f710ffff640 1 --2- 172.21.15.114:0/2056776278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71101591c0 0x7f711015f060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71000097a0 tx=0x7f710002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d835673fd34906c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.766+0000 7f710effd640 1 -- 172.21.15.114:0/2056776278 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100035020 con 0x7f71101591c0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.766+0000 7f710effd640 1 -- 172.21.15.114:0/2056776278 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100031830 con 0x7f71101591c0 2024-04-13T02:45:04.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.766+0000 7f710effd640 1 -- 172.21.15.114:0/2056776278 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100031c00 con 0x7f71101591c0 2024-04-13T02:45:04.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 -- 172.21.15.114:0/2056776278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71101591c0 msgr2=0x7f711015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 --2- 172.21.15.114:0/2056776278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71101591c0 0x7f711015f060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71000097a0 tx=0x7f710002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 -- 172.21.15.114:0/2056776278 shutdown_connections 2024-04-13T02:45:04.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 --2- 172.21.15.114:0/2056776278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f711009ace0 0x7f71100b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 --2- 172.21.15.114:0/2056776278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71101591c0 0x7f711015f060 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 -- 172.21.15.114:0/2056776278 >> 172.21.15.114:0/2056776278 conn(0x7f71100b7eb0 msgr2=0x7f71100b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 -- 172.21.15.114:0/2056776278 shutdown_connections 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.767+0000 7f71167bb640 1 -- 172.21.15.114:0/2056776278 wait complete. 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.768+0000 7f71167bb640 1 Processor -- start 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.768+0000 7f71167bb640 1 -- start start 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f71167bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f711009ace0 0x7f7110144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f71167bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71101591c0 0x7f711009f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f71167bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 0x7f7110146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f71167bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71100b6640 con 0x7f711015f5a0 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f71167bb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71100b6360 con 0x7f711009ace0 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f71167bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f711006db60 con 0x7f71101591c0 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 0x7f7110146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 0x7f7110146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37766/0 (socket says 172.21.15.114:37766) 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 -- 172.21.15.114:0/1476737110 learned_addr learned my addr 172.21.15.114:0/1476737110 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f710ffff640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f711009ace0 0x7f7110144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f710f7fe640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71101591c0 0x7f711009f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 -- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71101591c0 msgr2=0x7f711009f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71101591c0 0x7f711009f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 -- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f711009ace0 msgr2=0x7f7110144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f711009ace0 0x7f7110144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f7114d58640 1 -- 172.21.15.114:0/1476737110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7110145100 con 0x7f711015f5a0 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.769+0000 7f710f7fe640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71101591c0 0x7f711009f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.770+0000 7f7114d58640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 0x7f7110146a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f710800b9e0 tx=0x7f710800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.770+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108019070 con 0x7f711015f5a0 2024-04-13T02:45:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.770+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710800ca60 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.770+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711009fab0 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.770+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710800ce50 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.770+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7110145c90 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.771+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7110068c80 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.771+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f710801c070 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.771+0000 7f710cff9640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f70fc06ca90 0x7f70fc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.772+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f710808b810 con 0x7f711015f5a0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.772+0000 7f710ffff640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f70fc06ca90 0x7f70fc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.772+0000 7f710ffff640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f70fc06ca90 0x7f70fc06ef50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7100036000 tx=0x7f710003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:04.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.776+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7108059c40 con 0x7f711015f5a0 2024-04-13T02:45:04.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.954+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f711006d7d0 con 0x7f711015f5a0 2024-04-13T02:45:04.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.954+0000 7f710cff9640 1 -- 172.21.15.114:0/1476737110 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f7108059540 con 0x7f711015f5a0 2024-04-13T02:45:04.955 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:04.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f70fc06ca90 msgr2=0x7f70fc06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f70fc06ca90 0x7f70fc06ef50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7100036000 tx=0x7f710003c040 comp rx=0 tx=0).stop 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 msgr2=0x7f7110146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 0x7f7110146a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f710800b9e0 tx=0x7f710800bea0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 shutdown_connections 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711015f5a0 0x7f7110146a50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f70fc06ca90 0x7f70fc06ef50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71101591c0 0x7f711009f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 --2- 172.21.15.114:0/1476737110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f711009ace0 0x7f7110144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 >> 172.21.15.114:0/1476737110 conn(0x7f71100b7eb0 msgr2=0x7f7110070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 shutdown_connections 2024-04-13T02:45:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:04.957+0000 7f71167bb640 1 -- 172.21.15.114:0/1476737110 wait complete. 2024-04-13T02:45:04.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:05.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.071+0000 7fb50415e640 1 Processor -- start 2024-04-13T02:45:05.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.071+0000 7fb50415e640 1 -- start start 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb50415e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb4fc0b5830 0x7fb4fc15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb50415e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb4fc06b9c0 0x7fb4fc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb50415e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4fc0b41f0 con 0x7fb4fc067a40 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb50415e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb4fc0b4e00 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb50415e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb4fc0b44d0 con 0x7fb4fc0b5830 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5026fb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb4fc06b9c0 0x7fb4fc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5016f9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb4fc067a40 0x7fb4fc0b5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38860/0 (socket says 172.21.15.114:38860) 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5016f9640 1 -- 172.21.15.114:0/721535009 learned_addr learned my addr 172.21.15.114:0/721535009 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb501efa640 1 --2- 172.21.15.114:0/721535009 >> v2:172.21.15.130:3300/0 conn(0x7fb4fc0b5830 0x7fb4fc15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5026fb640 1 -- 172.21.15.114:0/721535009 >> v2:172.21.15.130:3300/0 conn(0x7fb4fc0b5830 msgr2=0x7fb4fc15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5026fb640 1 --2- 172.21.15.114:0/721535009 >> v2:172.21.15.130:3300/0 conn(0x7fb4fc0b5830 0x7fb4fc15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5026fb640 1 -- 172.21.15.114:0/721535009 >> v1:172.21.15.114:6789/0 conn(0x7fb4fc067a40 legacy=0x7fb4fc0b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb5026fb640 1 -- 172.21.15.114:0/721535009 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc0b47b0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.072+0000 7fb501efa640 1 --2- 172.21.15.114:0/721535009 >> v2:172.21.15.130:3300/0 conn(0x7fb4fc0b5830 0x7fb4fc15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:05.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.073+0000 7fb5026fb640 1 --2- 172.21.15.114:0/721535009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc06bdd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc04fe80 tx=0x7fb4f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62346d1c36fe8b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.073+0000 7fb500ef8640 1 -- 172.21.15.114:0/721535009 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4035020 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.073+0000 7fb500ef8640 1 -- 172.21.15.114:0/721535009 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f4031830 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.073+0000 7fb500ef8640 1 -- 172.21.15.114:0/721535009 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4031c00 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 -- 172.21.15.114:0/721535009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 msgr2=0x7fb4fc06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 --2- 172.21.15.114:0/721535009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc06bdd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc04fe80 tx=0x7fb4f402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 -- 172.21.15.114:0/721535009 shutdown_connections 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 --2- 172.21.15.114:0/721535009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc06bdd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 --2- 172.21.15.114:0/721535009 >> v2:172.21.15.130:3300/0 conn(0x7fb4fc0b5830 0x7fb4fc15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 -- 172.21.15.114:0/721535009 >> 172.21.15.114:0/721535009 conn(0x7fb4fc06ea10 msgr2=0x7fb4fc06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 -- 172.21.15.114:0/721535009 shutdown_connections 2024-04-13T02:45:05.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.074+0000 7fb50415e640 1 -- 172.21.15.114:0/721535009 wait complete. 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.075+0000 7fb50415e640 1 Processor -- start 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.075+0000 7fb50415e640 1 -- start start 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb50415e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc067a40 0x7fb4fc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb50415e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb50415e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b5830 0x7fb4fc0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb50415e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc0b64a0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb50415e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc0b6320 con 0x7fb4fc067a40 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb50415e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb4fc15f1c0 con 0x7fb4fc0b5830 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc0c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37786/0 (socket says 172.21.15.114:37786) 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 -- 172.21.15.114:0/4166966127 learned_addr learned my addr 172.21.15.114:0/4166966127 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb501efa640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc067a40 0x7fb4fc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5026fb640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b5830 0x7fb4fc0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 -- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b5830 msgr2=0x7fb4fc0c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b5830 0x7fb4fc0c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 -- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc067a40 msgr2=0x7fb4fc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc067a40 0x7fb4fc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 -- 172.21.15.114:0/4166966127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc1f5960 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb5016f9640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc0c6210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00c3c0 tx=0x7fb4ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.076+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec017070 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.077+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec005ce0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.077+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4fc1f5c40 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.077+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0072f0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.077+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4fc1f6200 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.078+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4fc068c80 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.078+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4ec01a070 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.078+0000 7fb4f27fc640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4e006c920 0x7fb4e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.079+0000 7fb501efa640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4e006c920 0x7fb4e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.079+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4ec08ae80 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.079+0000 7fb501efa640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4e006c920 0x7fb4e006ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80075b0 tx=0x7fb4f8007540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.083+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4ec0592b0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.257+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb4fc1f63d0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.257+0000 7fb4f27fc640 1 -- 172.21.15.114:0/4166966127 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fb4ec058bb0 con 0x7fb4fc06b9c0 2024-04-13T02:45:05.258 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4e006c920 msgr2=0x7fb4e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4e006c920 0x7fb4e006ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80075b0 tx=0x7fb4f8007540 comp rx=0 tx=0).stop 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 msgr2=0x7fb4fc0c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc0c6210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00c3c0 tx=0x7fb4ec00c880 comp rx=0 tx=0).stop 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 shutdown_connections 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4e006c920 0x7fb4e006ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b5830 0x7fb4fc0c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4fc06b9c0 0x7fb4fc0c6210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 --2- 172.21.15.114:0/4166966127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc067a40 0x7fb4fc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 >> 172.21.15.114:0/4166966127 conn(0x7fb4fc06ea10 msgr2=0x7fb4fc0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 shutdown_connections 2024-04-13T02:45:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.259+0000 7fb50415e640 1 -- 172.21.15.114:0/4166966127 wait complete. 2024-04-13T02:45:05.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.373+0000 7f77f5fbb640 1 Processor -- start 2024-04-13T02:45:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77f5fbb640 1 -- start start 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77f5fbb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 0x7f77f006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77f5fbb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f006deb0 con 0x7f77f009bba0 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77f5fbb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f006d6a0 con 0x7f77f00d2370 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77f5fbb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f77f006dc60 con 0x7f77f01622c0 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77effff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f77f009bba0 0x7f77f00d0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38866/0 (socket says 172.21.15.114:38866) 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.374+0000 7f77effff640 1 -- 172.21.15.114:0/3050993195 learned_addr learned my addr 172.21.15.114:0/3050993195 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ef7fe640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 0x7f77f006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67972698 0 0) 0x7f77f006deb0 con 0x7f77f009bba0 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77d8003520 con 0x7f77f009bba0 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2542411175 0 0) 0x7f77d8003520 con 0x7f77f009bba0 2024-04-13T02:45:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 msgr2=0x7f77f006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 0x7f77f006ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 >> v1:172.21.15.130:6789/0 conn(0x7f77f00d2370 legacy=0x7f77f00d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f006d980 con 0x7f77f009bba0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f77e80019f0 con 0x7f77f009bba0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 >> v1:172.21.15.114:6789/0 conn(0x7f77f009bba0 legacy=0x7f77f00d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77d80039e0 0x7f77d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77d8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 0x7f77d80050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77d800b9c0 con 0x7f77d8004390 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77d800bb40 con 0x7f77d80039e0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f77d800bd40 con 0x7f77f01622c0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77eeffd640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77d8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77ef7fe640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77d80039e0 0x7f77d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77effff640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 0x7f77d80050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77eeffd640 1 -- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 msgr2=0x7f77d80050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77eeffd640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f01622c0 0x7f77d80050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77eeffd640 1 -- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77d80039e0 msgr2=0x7f77d8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77eeffd640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77d80039e0 0x7f77d8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.375+0000 7f77eeffd640 1 -- 172.21.15.114:0/3050993195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d8003520 con 0x7f77d8004390 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.376+0000 7f77eeffd640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77d8004860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77e4001910 tx=0x7f77d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbd1460ba18a8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.376+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40014e0 con 0x7f77d8004390 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.376+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e4037070 con 0x7f77d8004390 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.376+0000 7f77ee7fc640 1 -- 172.21.15.114:0/3050993195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4032840 con 0x7f77d8004390 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3050993195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 msgr2=0x7f77d8004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3050993195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77d8004860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77e4001910 tx=0x7f77d8005830 comp rx=0 tx=0).stop 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77effff640 1 -- 172.21.15.114:0/3050993195 reap_dead start 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3050993195 shutdown_connections 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3050993195 >> 172.21.15.114:0/3050993195 conn(0x7f77f00d2750 msgr2=0x7f77f00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3050993195 shutdown_connections 2024-04-13T02:45:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.377+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3050993195 wait complete. 2024-04-13T02:45:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.378+0000 7f77f5fbb640 1 Processor -- start 2024-04-13T02:45:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.378+0000 7f77f5fbb640 1 -- start start 2024-04-13T02:45:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77f5fbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77f01f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77f5fbb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f00b7ed0 0x7f77f00b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77f5fbb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f0152e90 0x7f77f00c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77f5fbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77f006e720 con 0x7f77d8004390 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77f5fbb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77f006e120 con 0x7f77f0152e90 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77f5fbb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f77f006e8a0 con 0x7f77f00b7ed0 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77f01f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77f01f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37800/0 (socket says 172.21.15.114:37800) 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 -- 172.21.15.114:0/3985757300 learned_addr learned my addr 172.21.15.114:0/3985757300 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 -- 172.21.15.114:0/3985757300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f00b7ed0 msgr2=0x7f77f00b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f00b7ed0 0x7f77f00b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 -- 172.21.15.114:0/3985757300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f0152e90 msgr2=0x7f77f00c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f0152e90 0x7f77f00c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 -- 172.21.15.114:0/3985757300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f00b6a70 con 0x7f77d8004390 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77ef7fe640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77f01f3bc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77e0011940 tx=0x7f77e0011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.379+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e000fa10 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.380+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e000fbb0 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.380+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f00b7110 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.380+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0014440 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.380+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f00b76d0 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.380+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f0068c80 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.381+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77e0012040 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.381+0000 7f77d7fff640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f77dc06c8f0 0x7f77dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.381+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f77e008c010 con 0x7f77d8004390 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.381+0000 7f77eeffd640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f77dc06c8f0 0x7f77dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.382+0000 7f77eeffd640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f77dc06c8f0 0x7f77dc06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77e4001910 tx=0x7f77e4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.386+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77f00b6a70 con 0x7f77d8004390 2024-04-13T02:45:05.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.561+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f77f00712e0 con 0x7f77d8004390 2024-04-13T02:45:05.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.561+0000 7f77d7fff640 1 -- 172.21.15.114:0/3985757300 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f77e0019030 con 0x7f77d8004390 2024-04-13T02:45:05.562 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:05.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f77dc06c8f0 msgr2=0x7f77dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f77dc06c8f0 0x7f77dc06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77e4001910 tx=0x7f77e4030000 comp rx=0 tx=0).stop 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 msgr2=0x7f77f01f3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77f01f3bc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f77e0011940 tx=0x7f77e0011e00 comp rx=0 tx=0).stop 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 shutdown_connections 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f0152e90 0x7f77f00c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f77dc06c8f0 0x7f77dc06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f00b7ed0 0x7f77f00b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 --2- 172.21.15.114:0/3985757300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77d8004390 0x7f77f01f3bc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.563+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 >> 172.21.15.114:0/3985757300 conn(0x7f77f00d2750 msgr2=0x7f77f00b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.564+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 shutdown_connections 2024-04-13T02:45:05.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.564+0000 7f77f5fbb640 1 -- 172.21.15.114:0/3985757300 wait complete. 2024-04-13T02:45:05.606 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-04-13T02:45:05.607 INFO:tasks.cephfs_test_runner:test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-04-13T02:45:05.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.706+0000 7f4e74dc8640 1 Processor -- start 2024-04-13T02:45:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.706+0000 7f4e74dc8640 1 -- start start 2024-04-13T02:45:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e74dc8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4e70073180 0x7f4e700b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e74dc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e70073560 0x7f4e7006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e74dc8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e7006be70 0x7f4e7006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e74dc8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4e700b0a90 con 0x7f4e7006be70 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e74dc8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4e701604b0 con 0x7f4e70073180 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e74dc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4e70160790 con 0x7f4e70073560 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e7006be70 0x7f4e7006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e7006be70 0x7f4e7006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37804/0 (socket says 172.21.15.114:37804) 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/2219641942 learned_addr learned my addr 172.21.15.114:0/2219641942 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e67fff640 1 --2- 172.21.15.114:0/2219641942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e70073560 0x7f4e7006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/2219641942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e70073560 msgr2=0x7f4e7006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 --2- 172.21.15.114:0/2219641942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e70073560 0x7f4e7006b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6e59c640 1 --2- 172.21.15.114:0/2219641942 >> v2:172.21.15.130:3300/0 conn(0x7f4e70073180 0x7f4e700b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/2219641942 >> v2:172.21.15.130:3300/0 conn(0x7f4e70073180 msgr2=0x7f4e700b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 --2- 172.21.15.114:0/2219641942 >> v2:172.21.15.130:3300/0 conn(0x7f4e70073180 0x7f4e700b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.707+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/2219641942 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e70160a70 con 0x7f4e7006be70 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.708+0000 7f4e6ed9d640 1 --2- 172.21.15.114:0/2219641942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7006be70 0x7f4e7006c300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4e7006d440 tx=0x7f4e6802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f92ed68b030668 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.708+0000 7f4e6dd9b640 1 -- 172.21.15.114:0/2219641942 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6802c9e0 con 0x7f4e7006be70 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.708+0000 7f4e6dd9b640 1 -- 172.21.15.114:0/2219641942 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6802cb80 con 0x7f4e7006be70 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.708+0000 7f4e6dd9b640 1 -- 172.21.15.114:0/2219641942 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680343f0 con 0x7f4e7006be70 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 -- 172.21.15.114:0/2219641942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7006be70 msgr2=0x7f4e7006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/2219641942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7006be70 0x7f4e7006c300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4e7006d440 tx=0x7f4e6802be40 comp rx=0 tx=0).stop 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 -- 172.21.15.114:0/2219641942 shutdown_connections 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/2219641942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7006be70 0x7f4e7006c300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/2219641942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e70073560 0x7f4e7006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/2219641942 >> v2:172.21.15.130:3300/0 conn(0x7f4e70073180 0x7f4e700b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 -- 172.21.15.114:0/2219641942 >> 172.21.15.114:0/2219641942 conn(0x7f4e7006f860 msgr2=0x7f4e70072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 -- 172.21.15.114:0/2219641942 shutdown_connections 2024-04-13T02:45:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.709+0000 7f4e74dc8640 1 -- 172.21.15.114:0/2219641942 wait complete. 2024-04-13T02:45:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.710+0000 7f4e74dc8640 1 Processor -- start 2024-04-13T02:45:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.710+0000 7f4e74dc8640 1 -- start start 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e74dc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7006be70 0x7f4e701500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e74dc8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70073180 0x7f4e700ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e74dc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 0x7f4e700b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e74dc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7015a6a0 con 0x7f4e70073560 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e74dc8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700739e0 con 0x7f4e70073180 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e74dc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700aec40 con 0x7f4e7006be70 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 0x7f4e700b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 0x7f4e700b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37806/0 (socket says 172.21.15.114:37806) 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/3485543635 learned_addr learned my addr 172.21.15.114:0/3485543635 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e67fff640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70073180 0x7f4e700ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6e59c640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7006be70 0x7f4e701500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7006be70 msgr2=0x7f4e701500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7006be70 0x7f4e701500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70073180 msgr2=0x7f4e700ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70073180 0x7f4e700ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e6ed9d640 1 -- 172.21.15.114:0/3485543635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700b4350 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.711+0000 7f4e67fff640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70073180 0x7f4e700ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.712+0000 7f4e6ed9d640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 0x7f4e700b1340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009f40 tx=0x7f4e68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.712+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68043020 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.712+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6803e450 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.712+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6803e820 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.712+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e700b4630 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.712+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e700b4bf0 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.713+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e70068c80 con 0x7f4e70073560 2024-04-13T02:45:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.713+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e68046020 con 0x7f4e70073560 2024-04-13T02:45:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.714+0000 7f4e66ffd640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4e5006c920 0x7f4e5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.714+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e680ae130 con 0x7f4e70073560 2024-04-13T02:45:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.714+0000 7f4e6e59c640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4e5006c920 0x7f4e5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.714+0000 7f4e6e59c640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4e5006c920 0x7f4e5006ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000b740 tx=0x7f4e60008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:05.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.718+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e6804d070 con 0x7f4e70073560 2024-04-13T02:45:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.894+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e70067d20 con 0x7f4e70073560 2024-04-13T02:45:05.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.896+0000 7f4e66ffd640 1 -- 172.21.15.114:0/3485543635 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f4e6807c5f0 con 0x7f4e70073560 2024-04-13T02:45:05.896 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:05.897 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.897+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4e5006c920 msgr2=0x7f4e5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.897+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4e5006c920 0x7f4e5006ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000b740 tx=0x7f4e60008040 comp rx=0 tx=0).stop 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.897+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 msgr2=0x7f4e700b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 0x7f4e700b1340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009f40 tx=0x7f4e68004a40 comp rx=0 tx=0).stop 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 shutdown_connections 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e70073560 0x7f4e700b1340 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70073180 0x7f4e700ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4e5006c920 0x7f4e5006ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 --2- 172.21.15.114:0/3485543635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7006be70 0x7f4e701500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 >> 172.21.15.114:0/3485543635 conn(0x7f4e7006f860 msgr2=0x7f4e700cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 shutdown_connections 2024-04-13T02:45:05.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:05.898+0000 7f4e74dc8640 1 -- 172.21.15.114:0/3485543635 wait complete. 2024-04-13T02:45:05.910 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:05.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:06.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.012+0000 7ff8fb995640 1 Processor -- start 2024-04-13T02:45:06.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.013+0000 7ff8fb995640 1 -- start start 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.013+0000 7ff8fb995640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 0x7ff8f40cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.013+0000 7ff8fb995640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f40ba4d0 con 0x7ff8f40b3720 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.013+0000 7ff8fb995640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f40ba7b0 con 0x7ff8f415ecc0 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.013+0000 7ff8fb995640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f415f0a0 con 0x7ff8f40b3c70 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8f8f30640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff8f40b3720 0x7ff8f40b95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38876/0 (socket says 172.21.15.114:38876) 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8f8f30640 1 -- 172.21.15.114:0/2463896644 learned_addr learned my addr 172.21.15.114:0/2463896644 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800696081 0 0) 0x7ff8f40ba4d0 con 0x7ff8f40b3720 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e0003520 con 0x7ff8f40b3720 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 0x7ff8f40cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714538157 0 0) 0x7ff8e0003520 con 0x7ff8f40b3720 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 msgr2=0x7ff8f40cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 0x7ff8f40cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 >> v1:172.21.15.130:6789/0 conn(0x7ff8f415ecc0 legacy=0x7ff8f40d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f40b8df0 con 0x7ff8f40b3720 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7ff8e4001670 con 0x7ff8f40b3720 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 >> v1:172.21.15.114:6789/0 conn(0x7ff8f40b3720 legacy=0x7ff8f40b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 0x7ff8e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0003f20 0x7ff8e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8e0004d40 0x7ff8e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f415f0a0 con 0x7ff8e0004d40 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000ba20 con 0x7ff8e0003f20 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e000bc20 con 0x7ff8f40b3c70 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8e0004d40 0x7ff8e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8f8f30640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0003f20 0x7ff8e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.014+0000 7ff8f9731640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 0x7ff8e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8f9f32640 1 -- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 msgr2=0x7ff8e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f40b3c70 0x7ff8e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8f9f32640 1 -- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0003f20 msgr2=0x7ff8e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8e0003f20 0x7ff8e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8f9f32640 1 -- 172.21.15.114:0/2463896644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e0003520 con 0x7ff8e0004d40 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8e0004d40 0x7ff8e00051c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009fc0 tx=0x7ff8e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5780a5a61ff53456 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec039070 con 0x7ff8e0004d40 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec02cc20 con 0x7ff8e0004d40 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.015+0000 7ff8ebfff640 1 -- 172.21.15.114:0/2463896644 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec009c10 con 0x7ff8e0004d40 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8fb995640 1 -- 172.21.15.114:0/2463896644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8e0004d40 msgr2=0x7ff8e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8fb995640 1 --2- 172.21.15.114:0/2463896644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8e0004d40 0x7ff8e00051c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009fc0 tx=0x7ff8e0005830 comp rx=0 tx=0).stop 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8f9f32640 1 -- 172.21.15.114:0/2463896644 reap_dead start 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8fb995640 1 -- 172.21.15.114:0/2463896644 shutdown_connections 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8fb995640 1 -- 172.21.15.114:0/2463896644 >> 172.21.15.114:0/2463896644 conn(0x7ff8f4073480 msgr2=0x7ff8f4073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8fb995640 1 -- 172.21.15.114:0/2463896644 shutdown_connections 2024-04-13T02:45:06.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.016+0000 7ff8fb995640 1 -- 172.21.15.114:0/2463896644 wait complete. 2024-04-13T02:45:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.017+0000 7ff8fb995640 1 Processor -- start 2024-04-13T02:45:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.017+0000 7ff8fb995640 1 -- start start 2024-04-13T02:45:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8fb995640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8e0004d40 0x7ff8f4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8fb995640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f40cc250 0x7ff8f40ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8fb995640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 0x7ff8f40b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8fb995640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f40b8aa0 con 0x7ff8f40b7a90 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8fb995640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f40ba280 con 0x7ff8f40cc250 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8fb995640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f40d3440 con 0x7ff8e0004d40 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 0x7ff8f40b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 0x7ff8f40b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37818/0 (socket says 172.21.15.114:37818) 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 -- 172.21.15.114:0/500841592 learned_addr learned my addr 172.21.15.114:0/500841592 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9731640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8e0004d40 0x7ff8f4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f8f30640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f40cc250 0x7ff8f40ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 -- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8e0004d40 msgr2=0x7ff8f4154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8e0004d40 0x7ff8f4154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 -- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f40cc250 msgr2=0x7ff8f40ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f40cc250 0x7ff8f40ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 -- 172.21.15.114:0/500841592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f4155380 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9731640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8e0004d40 0x7ff8f4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.018+0000 7ff8f9f32640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 0x7ff8f40b7f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec002230 tx=0x7ff8ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.019+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec039030 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.019+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec043070 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.019+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f415f990 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.019+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec03d7f0 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.019+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f415ff50 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.020+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f4068c60 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.020+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8ec005d10 con 0x7ff8f40b7a90 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.021+0000 7ff8e9ffb640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff8d806c920 0x7ff8d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.021+0000 7ff8f9731640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff8d806c920 0x7ff8d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.021+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8ec0addb0 con 0x7ff8f40b7a90 2024-04-13T02:45:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.021+0000 7ff8f9731640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff8d806c920 0x7ff8d806ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0001970 tx=0x7ff8f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.025+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8ec07c270 con 0x7ff8f40b7a90 2024-04-13T02:45:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.199+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8f40b9a20 con 0x7ff8f40b7a90 2024-04-13T02:45:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.199+0000 7ff8e9ffb640 1 -- 172.21.15.114:0/500841592 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff8ec07bb70 con 0x7ff8f40b7a90 2024-04-13T02:45:06.200 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:06.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff8d806c920 msgr2=0x7ff8d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff8d806c920 0x7ff8d806ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0001970 tx=0x7ff8f0009040 comp rx=0 tx=0).stop 2024-04-13T02:45:06.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 msgr2=0x7ff8f40b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 0x7ff8f40b7f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec002230 tx=0x7ff8ec009750 comp rx=0 tx=0).stop 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 shutdown_connections 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f40b7a90 0x7ff8f40b7f40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f40cc250 0x7ff8f40ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff8d806c920 0x7ff8d806ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 --2- 172.21.15.114:0/500841592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8e0004d40 0x7ff8f4154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 >> 172.21.15.114:0/500841592 conn(0x7ff8f4073480 msgr2=0x7ff8f415dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 shutdown_connections 2024-04-13T02:45:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.201+0000 7ff8fb995640 1 -- 172.21.15.114:0/500841592 wait complete. 2024-04-13T02:45:06.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:06.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.315+0000 7f1c2351e640 1 Processor -- start 2024-04-13T02:45:06.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.316+0000 7f1c2351e640 1 -- start start 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.316+0000 7f1c2351e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c1c0b4e80 0x7f1c1c0b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.316+0000 7f1c2351e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1c1c0afd40 0x7f1c1c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.316+0000 7f1c2351e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c1c0aef80 con 0x7f1c1c0b0990 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.316+0000 7f1c2351e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1c1c0af260 con 0x7f1c1c0b4e80 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.316+0000 7f1c2351e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1c1c0af540 con 0x7f1c1c0afd40 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c212ba640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c1c0b4e80 0x7f1c1c0b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c20ab9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c1c0b0990 0x7f1c1c0b5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38880/0 (socket says 172.21.15.114:38880) 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c20ab9640 1 -- 172.21.15.114:0/3393464036 learned_addr learned my addr 172.21.15.114:0/3393464036 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:06.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c21abb640 1 --2- 172.21.15.114:0/3393464036 >> v2:172.21.15.130:3300/0 conn(0x7f1c1c0afd40 0x7f1c1c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c212ba640 1 -- 172.21.15.114:0/3393464036 >> v2:172.21.15.130:3300/0 conn(0x7f1c1c0afd40 msgr2=0x7f1c1c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c212ba640 1 --2- 172.21.15.114:0/3393464036 >> v2:172.21.15.130:3300/0 conn(0x7f1c1c0afd40 0x7f1c1c06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c212ba640 1 -- 172.21.15.114:0/3393464036 >> v1:172.21.15.114:6789/0 conn(0x7f1c1c0b0990 legacy=0x7f1c1c0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c13fff640 1 -- 172.21.15.114:0/3393464036 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169355227 0 0) 0x7f1c1c0aef80 con 0x7f1c1c0b0990 2024-04-13T02:45:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c212ba640 1 -- 172.21.15.114:0/3393464036 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c0aec70 con 0x7f1c1c0b4e80 2024-04-13T02:45:06.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.317+0000 7f1c21abb640 1 --2- 172.21.15.114:0/3393464036 >> v2:172.21.15.130:3300/0 conn(0x7f1c1c0afd40 0x7f1c1c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c212ba640 1 --2- 172.21.15.114:0/3393464036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b4e80 0x7f1c1c0b0450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06d840 tx=0x7f1c1802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3fde58793f465d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c13fff640 1 -- 172.21.15.114:0/3393464036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18035020 con 0x7f1c1c0b4e80 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c13fff640 1 -- 172.21.15.114:0/3393464036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18031830 con 0x7f1c1c0b4e80 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c13fff640 1 -- 172.21.15.114:0/3393464036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18031c00 con 0x7f1c1c0b4e80 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 -- 172.21.15.114:0/3393464036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b4e80 msgr2=0x7f1c1c0b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 --2- 172.21.15.114:0/3393464036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b4e80 0x7f1c1c0b0450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06d840 tx=0x7f1c1802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 -- 172.21.15.114:0/3393464036 shutdown_connections 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 --2- 172.21.15.114:0/3393464036 >> v2:172.21.15.130:3300/0 conn(0x7f1c1c0afd40 0x7f1c1c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 --2- 172.21.15.114:0/3393464036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b4e80 0x7f1c1c0b0450 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 -- 172.21.15.114:0/3393464036 >> 172.21.15.114:0/3393464036 conn(0x7f1c1c073720 msgr2=0x7f1c1c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 -- 172.21.15.114:0/3393464036 shutdown_connections 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.318+0000 7f1c2351e640 1 -- 172.21.15.114:0/3393464036 wait complete. 2024-04-13T02:45:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 Processor -- start 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 -- start start 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c1c0afd40 0x7f1c1c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 0x7f1c1c09dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c1c0b4e80 0x7f1c1c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c0b5af0 con 0x7f1c1c0b0990 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c0b5970 con 0x7f1c1c0afd40 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c2351e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1c0b5c70 con 0x7f1c1c0b4e80 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c20ab9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 0x7f1c1c09dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c20ab9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 0x7f1c1c09dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37836/0 (socket says 172.21.15.114:37836) 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.320+0000 7f1c20ab9640 1 -- 172.21.15.114:0/4273064219 learned_addr learned my addr 172.21.15.114:0/4273064219 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c212ba640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c1c0afd40 0x7f1c1c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c21abb640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c1c0b4e80 0x7f1c1c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c20ab9640 1 -- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c1c0b4e80 msgr2=0x7f1c1c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c20ab9640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c1c0b4e80 0x7f1c1c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c20ab9640 1 -- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c1c0afd40 msgr2=0x7f1c1c152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c20ab9640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c1c0afd40 0x7f1c1c152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c20ab9640 1 -- 172.21.15.114:0/4273064219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c09e7c0 con 0x7f1c1c0b0990 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c21abb640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c1c0b4e80 0x7f1c1c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c20ab9640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 0x7f1c1c09dd90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00c4e0 tx=0x7f1c0c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c018070 con 0x7f1c1c0b0990 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0c007500 con 0x7f1c1c0b0990 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1c09eaa0 con 0x7f1c1c0b0990 2024-04-13T02:45:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c004a20 con 0x7f1c1c0b0990 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.321+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1c09f060 con 0x7f1c1c0b0990 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.322+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1c068c80 con 0x7f1c1c0b0990 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.322+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c0c01b070 con 0x7f1c1c0b0990 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.323+0000 7f1c11ffb640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c0006c8f0 0x7f1c0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.323+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c0c08ae20 con 0x7f1c1c0b0990 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.323+0000 7f1c212ba640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c0006c8f0 0x7f1c0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.323+0000 7f1c212ba640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c0006c8f0 0x7f1c0006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c18036000 tx=0x7f1c18008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.327+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c0c0593a0 con 0x7f1c1c0b0990 2024-04-13T02:45:06.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.499+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1c1c0b5360 con 0x7f1c1c0b0990 2024-04-13T02:45:06.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.500+0000 7f1c11ffb640 1 -- 172.21.15.114:0/4273064219 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1c0c058ca0 con 0x7f1c1c0b0990 2024-04-13T02:45:06.501 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c0006c8f0 msgr2=0x7f1c0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c0006c8f0 0x7f1c0006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c18036000 tx=0x7f1c18008030 comp rx=0 tx=0).stop 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 msgr2=0x7f1c1c09dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 0x7f1c1c09dd90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00c4e0 tx=0x7f1c0c00c9a0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 shutdown_connections 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1c0006c8f0 0x7f1c0006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c1c0b4e80 0x7f1c1c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1c0b0990 0x7f1c1c09dd90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 --2- 172.21.15.114:0/4273064219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c1c0afd40 0x7f1c1c152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 >> 172.21.15.114:0/4273064219 conn(0x7f1c1c073720 msgr2=0x7f1c1c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 shutdown_connections 2024-04-13T02:45:06.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.502+0000 7f1c2351e640 1 -- 172.21.15.114:0/4273064219 wait complete. 2024-04-13T02:45:06.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:06.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.616+0000 7fd0f42de640 1 Processor -- start 2024-04-13T02:45:06.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.616+0000 7fd0f42de640 1 -- start start 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f42de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd0ec0702f0 0x7fd0ec15f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f42de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd0ec163300 0x7fd0ec15f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f42de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec15fb80 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f42de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec162e70 con 0x7fd0ec163300 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f42de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec15fe30 con 0x7fd0ec0702f0 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd0ec163300 0x7fd0ec15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd0ec163300 0x7fd0ec15f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37842/0 (socket says 172.21.15.114:37842) 2024-04-13T02:45:06.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 -- 172.21.15.114:0/1268770313 learned_addr learned my addr 172.21.15.114:0/1268770313 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:06.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f1879640 1 --2- 172.21.15.114:0/1268770313 >> v2:172.21.15.130:3300/0 conn(0x7fd0ec0702f0 0x7fd0ec15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 -- 172.21.15.114:0/1268770313 >> v2:172.21.15.130:3300/0 conn(0x7fd0ec0702f0 msgr2=0x7fd0ec15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 --2- 172.21.15.114:0/1268770313 >> v2:172.21.15.130:3300/0 conn(0x7fd0ec0702f0 0x7fd0ec15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 -- 172.21.15.114:0/1268770313 >> v1:172.21.15.130:6789/0 conn(0x7fd0ec15ebc0 legacy=0x7fd0ec06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.617+0000 7fd0f287b640 1 -- 172.21.15.114:0/1268770313 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec162820 con 0x7fd0ec163300 2024-04-13T02:45:06.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.618+0000 7fd0f287b640 1 --2- 172.21.15.114:0/1268770313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec163300 0x7fd0ec15f640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b6b70 tx=0x7fd0e402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec3923ab85f46ec server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.618+0000 7fd0f1078640 1 -- 172.21.15.114:0/1268770313 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e402cb20 con 0x7fd0ec163300 2024-04-13T02:45:06.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.618+0000 7fd0f1078640 1 -- 172.21.15.114:0/1268770313 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e402ccc0 con 0x7fd0ec163300 2024-04-13T02:45:06.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.618+0000 7fd0f1078640 1 -- 172.21.15.114:0/1268770313 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4034610 con 0x7fd0ec163300 2024-04-13T02:45:06.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 -- 172.21.15.114:0/1268770313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec163300 msgr2=0x7fd0ec15f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1268770313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec163300 0x7fd0ec15f640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b6b70 tx=0x7fd0e402bf80 comp rx=0 tx=0).stop 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 -- 172.21.15.114:0/1268770313 shutdown_connections 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1268770313 >> v2:172.21.15.130:3300/0 conn(0x7fd0ec0702f0 0x7fd0ec15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1268770313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec163300 0x7fd0ec15f640 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 -- 172.21.15.114:0/1268770313 >> 172.21.15.114:0/1268770313 conn(0x7fd0ec09aa40 msgr2=0x7fd0ec09ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 -- 172.21.15.114:0/1268770313 shutdown_connections 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.619+0000 7fd0f42de640 1 -- 172.21.15.114:0/1268770313 wait complete. 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.620+0000 7fd0f42de640 1 Processor -- start 2024-04-13T02:45:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.620+0000 7fd0f42de640 1 -- start start 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.620+0000 7fd0f42de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0ec0702f0 0x7fd0ec0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.620+0000 7fd0f42de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 0x7fd0ec09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f42de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0ec163300 0x7fd0ec0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f42de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec0d1760 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f42de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec0d15e0 con 0x7fd0ec0702f0 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f42de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec0d18e0 con 0x7fd0ec163300 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 0x7fd0ec09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 0x7fd0ec09f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37844/0 (socket says 172.21.15.114:37844) 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 -- 172.21.15.114:0/1743280685 learned_addr learned my addr 172.21.15.114:0/1743280685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f207a640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0ec0702f0 0x7fd0ec0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 -- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0ec163300 msgr2=0x7fd0ec0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f287b640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0ec163300 0x7fd0ec0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0ec163300 0x7fd0ec0cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 -- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0ec0702f0 msgr2=0x7fd0ec0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0ec0702f0 0x7fd0ec0cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 -- 172.21.15.114:0/1743280685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec15a870 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f1879640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 0x7fd0ec09f1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00e9b0 tx=0x7fd0dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc017070 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00c9a0 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec15ab50 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00cd90 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.621+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec15b110 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.622+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec068c80 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.623+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0dc01a070 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.623+0000 7fd0e2ffd640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd0d006c8f0 0x7fd0d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.623+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd0dc08bf20 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.623+0000 7fd0f207a640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd0d006c8f0 0x7fd0d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.623+0000 7fd0f207a640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd0d006c8f0 0x7fd0d006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8001640 tx=0x7fd0e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.627+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0dc05a350 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.803+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd0ec147dc0 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.804+0000 7fd0e2ffd640 1 -- 172.21.15.114:0/1743280685 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd0dc059c50 con 0x7fd0ec15ebc0 2024-04-13T02:45:06.805 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd0d006c8f0 msgr2=0x7fd0d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd0d006c8f0 0x7fd0d006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8001640 tx=0x7fd0e8009040 comp rx=0 tx=0).stop 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 msgr2=0x7fd0ec09f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 0x7fd0ec09f1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00e9b0 tx=0x7fd0dc00ee70 comp rx=0 tx=0).stop 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 shutdown_connections 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd0d006c8f0 0x7fd0d006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0ec163300 0x7fd0ec0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0ec15ebc0 0x7fd0ec09f1a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 --2- 172.21.15.114:0/1743280685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0ec0702f0 0x7fd0ec0cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 >> 172.21.15.114:0/1743280685 conn(0x7fd0ec09aa40 msgr2=0x7fd0ec074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 shutdown_connections 2024-04-13T02:45:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.806+0000 7fd0f42de640 1 -- 172.21.15.114:0/1743280685 wait complete. 2024-04-13T02:45:06.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-04-13T02:45:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.917+0000 7f0114498640 1 Processor -- start 2024-04-13T02:45:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.917+0000 7f0114498640 1 -- start start 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0114498640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f010c159240 0x7f010c15fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0114498640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f010c06cb50 0x7f010c073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0114498640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c0736c0 0x7f010c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0114498640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f010c0cd8f0 con 0x7f010c159240 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0114498640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f010c162760 con 0x7f010c06cb50 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0114498640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f010c160090 con 0x7f010c0736c0 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f010c159240 0x7f010c15fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f010c159240 0x7f010c15fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37856/0 (socket says 172.21.15.114:37856) 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 -- 172.21.15.114:0/3183418379 learned_addr learned my addr 172.21.15.114:0/3183418379 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0111a33640 1 --2- 172.21.15.114:0/3183418379 >> v2:172.21.15.130:3300/0 conn(0x7f010c06cb50 0x7f010c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 -- 172.21.15.114:0/3183418379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c0736c0 msgr2=0x7f010c06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 --2- 172.21.15.114:0/3183418379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c0736c0 0x7f010c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 -- 172.21.15.114:0/3183418379 >> v2:172.21.15.130:3300/0 conn(0x7f010c06cb50 msgr2=0x7f010c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 --2- 172.21.15.114:0/3183418379 >> v2:172.21.15.130:3300/0 conn(0x7f010c06cb50 0x7f010c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0112234640 1 -- 172.21.15.114:0/3183418379 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c1629d0 con 0x7f010c159240 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.918+0000 7f0111a33640 1 --2- 172.21.15.114:0/3183418379 >> v2:172.21.15.130:3300/0 conn(0x7f010c06cb50 0x7f010c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.919+0000 7f0112234640 1 --2- 172.21.15.114:0/3183418379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c159240 0x7f010c15fb50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f010c06d440 tx=0x7f010802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f39e29305c5e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.919+0000 7f0111232640 1 -- 172.21.15.114:0/3183418379 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010802ca70 con 0x7f010c159240 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.919+0000 7f0111232640 1 -- 172.21.15.114:0/3183418379 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010802cc10 con 0x7f010c159240 2024-04-13T02:45:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.919+0000 7f0111232640 1 -- 172.21.15.114:0/3183418379 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080343f0 con 0x7f010c159240 2024-04-13T02:45:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 -- 172.21.15.114:0/3183418379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c159240 msgr2=0x7f010c15fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 --2- 172.21.15.114:0/3183418379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c159240 0x7f010c15fb50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f010c06d440 tx=0x7f010802bed0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 -- 172.21.15.114:0/3183418379 shutdown_connections 2024-04-13T02:45:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 --2- 172.21.15.114:0/3183418379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c0736c0 0x7f010c06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 --2- 172.21.15.114:0/3183418379 >> v2:172.21.15.130:3300/0 conn(0x7f010c06cb50 0x7f010c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 --2- 172.21.15.114:0/3183418379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c159240 0x7f010c15fb50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 -- 172.21.15.114:0/3183418379 >> 172.21.15.114:0/3183418379 conn(0x7f010c06f860 msgr2=0x7f010c072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 -- 172.21.15.114:0/3183418379 shutdown_connections 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.920+0000 7f0114498640 1 -- 172.21.15.114:0/3183418379 wait complete. 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.921+0000 7f0114498640 1 Processor -- start 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.921+0000 7f0114498640 1 -- start start 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 0x7f010c143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f010c0736c0 0x7f010c0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c159240 0x7f010c159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f010c06be70 con 0x7f010c06cb50 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f010c162f90 con 0x7f010c0736c0 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f010c06bff0 con 0x7f010c159240 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 0x7f010c143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 0x7f010c143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37860/0 (socket says 172.21.15.114:37860) 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 -- 172.21.15.114:0/677417996 learned_addr learned my addr 172.21.15.114:0/677417996 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0111a33640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f010c0736c0 0x7f010c0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112a35640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c159240 0x7f010c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 -- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c159240 msgr2=0x7f010c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c159240 0x7f010c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 -- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f010c0736c0 msgr2=0x7f010c0b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f010c0736c0 0x7f010c0b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 -- 172.21.15.114:0/677417996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c0b4f70 con 0x7f010c06cb50 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112a35640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c159240 0x7f010c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0112234640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 0x7f010c143910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0108009e50 tx=0x7f0108004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108043020 con 0x7f010c06cb50 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010803e450 con 0x7f010c06cb50 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c0b5250 con 0x7f010c06cb50 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010803e820 con 0x7f010c06cb50 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.922+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c0b5810 con 0x7f010c06cb50 2024-04-13T02:45:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.923+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c0680c0 con 0x7f010c06cb50 2024-04-13T02:45:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.924+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0108005d10 con 0x7f010c06cb50 2024-04-13T02:45:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.924+0000 7f0102ffd640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f00f006c920 0x7f00f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.924+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01080ae750 con 0x7f010c06cb50 2024-04-13T02:45:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.924+0000 7f0111a33640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f00f006c920 0x7f00f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.925+0000 7f0111a33640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f00f006c920 0x7f00f006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f010c0d0ed0 tx=0x7f00fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:06.929+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f010807cb00 con 0x7f010c06cb50 2024-04-13T02:45:07.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.169+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7f010c1588d0 con 0x7f010c06cb50 2024-04-13T02:45:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.293+0000 7f0102ffd640 1 -- 172.21.15.114:0/677417996 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v48) ==== 138+0+0 (secure 0 0 0) 0x7f010807c400 con 0x7f010c06cb50 2024-04-13T02:45:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f00f006c920 msgr2=0x7f00f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f00f006c920 0x7f00f006ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f010c0d0ed0 tx=0x7f00fc008040 comp rx=0 tx=0).stop 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 msgr2=0x7f010c143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 0x7f010c143910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0108009e50 tx=0x7f0108004a40 comp rx=0 tx=0).stop 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 shutdown_connections 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f00f006c920 0x7f00f006ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f010c159240 0x7f010c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f010c0736c0 0x7f010c0b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 --2- 172.21.15.114:0/677417996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f010c06cb50 0x7f010c143910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 >> 172.21.15.114:0/677417996 conn(0x7f010c06f860 msgr2=0x7f010c15d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 shutdown_connections 2024-04-13T02:45:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.296+0000 7f0114498640 1 -- 172.21.15.114:0/677417996 wait complete. 2024-04-13T02:45:07.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-13T02:45:07.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.409+0000 7f9fe561c640 1 Processor -- start 2024-04-13T02:45:07.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.409+0000 7f9fe561c640 1 -- start start 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.409+0000 7f9fe561c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fe00b3c70 0x7f9fe00cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.409+0000 7f9fe561c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe00ba4d0 con 0x7f9fe00b3720 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.409+0000 7f9fe561c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe00ba7b0 con 0x7f9fe015ecc0 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.409+0000 7f9fe561c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe015f0a0 con 0x7f9fe00b3c70 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.410+0000 7f9fdf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fe00b3c70 0x7f9fe00cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.410+0000 7f9fde7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9fe00b3720 0x7f9fe00b95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38894/0 (socket says 172.21.15.114:38894) 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.410+0000 7f9fde7fc640 1 -- 172.21.15.114:0/2612777071 learned_addr learned my addr 172.21.15.114:0/2612777071 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.410+0000 7f9fdf7fe640 1 -- 172.21.15.114:0/2612777071 >> v1:172.21.15.130:6789/0 conn(0x7f9fe015ecc0 legacy=0x7f9fe00d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.410+0000 7f9fdf7fe640 1 -- 172.21.15.114:0/2612777071 >> v1:172.21.15.114:6789/0 conn(0x7f9fe00b3720 legacy=0x7f9fe00b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.410+0000 7f9fdf7fe640 1 -- 172.21.15.114:0/2612777071 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe00b8df0 con 0x7f9fe00b3c70 2024-04-13T02:45:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fdf7fe640 1 --2- 172.21.15.114:0/2612777071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3c70 0x7f9fe00cf6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009d90 tx=0x7f9fd802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffd606707944de4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fddffb640 1 -- 172.21.15.114:0/2612777071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8039070 con 0x7f9fe00b3c70 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fddffb640 1 -- 172.21.15.114:0/2612777071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd802cd00 con 0x7f9fe00b3c70 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fddffb640 1 -- 172.21.15.114:0/2612777071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8034660 con 0x7f9fe00b3c70 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 -- 172.21.15.114:0/2612777071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3c70 msgr2=0x7f9fe00cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 --2- 172.21.15.114:0/2612777071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3c70 0x7f9fe00cf6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009d90 tx=0x7f9fd802bf50 comp rx=0 tx=0).stop 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 -- 172.21.15.114:0/2612777071 shutdown_connections 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 --2- 172.21.15.114:0/2612777071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3c70 0x7f9fe00cf6a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 -- 172.21.15.114:0/2612777071 >> 172.21.15.114:0/2612777071 conn(0x7f9fe0073480 msgr2=0x7f9fe0073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 -- 172.21.15.114:0/2612777071 shutdown_connections 2024-04-13T02:45:07.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.411+0000 7f9fe561c640 1 -- 172.21.15.114:0/2612777071 wait complete. 2024-04-13T02:45:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 Processor -- start 2024-04-13T02:45:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 -- start start 2024-04-13T02:45:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 0x7f9fe0161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9fe00b3c70 0x7f9fe015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9fe015ecc0 0x7f9fe0158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00b8aa0 con 0x7f9fe00b3720 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00ba280 con 0x7f9fe00b3c70 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fe561c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe00d3440 con 0x7f9fe015ecc0 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fdeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 0x7f9fe0161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fdeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 0x7f9fe0161c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37880/0 (socket says 172.21.15.114:37880) 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.413+0000 7f9fdeffd640 1 -- 172.21.15.114:0/526330343 learned_addr learned my addr 172.21.15.114:0/526330343 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fde7fc640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9fe00b3c70 0x7f9fe015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdf7fe640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9fe015ecc0 0x7f9fe0158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdeffd640 1 -- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9fe015ecc0 msgr2=0x7f9fe0158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdeffd640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9fe015ecc0 0x7f9fe0158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdeffd640 1 -- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9fe00b3c70 msgr2=0x7f9fe015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdeffd640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9fe00b3c70 0x7f9fe015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdeffd640 1 -- 172.21.15.114:0/526330343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe015cfb0 con 0x7f9fe00b3720 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fde7fc640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9fe00b3c70 0x7f9fe015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdf7fe640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9fe015ecc0 0x7f9fe0158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fdeffd640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 0x7f9fe0161c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c3c0 tx=0x7f9fd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00052d0 con 0x7f9fe00b3720 2024-04-13T02:45:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0005490 con 0x7f9fe00b3720 2024-04-13T02:45:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe015d220 con 0x7f9fe00b3720 2024-04-13T02:45:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007260 con 0x7f9fe00b3720 2024-04-13T02:45:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.414+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe015d7e0 con 0x7f9fe00b3720 2024-04-13T02:45:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.415+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe0068c80 con 0x7f9fe00b3720 2024-04-13T02:45:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.415+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fd0007400 con 0x7f9fe00b3720 2024-04-13T02:45:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.416+0000 7f9fc77fe640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9fcc06c8f0 0x7f9fcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.416+0000 7f9fde7fc640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9fcc06c8f0 0x7f9fcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.416+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd008af80 con 0x7f9fe00b3720 2024-04-13T02:45:07.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.416+0000 7f9fde7fc640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9fcc06c8f0 0x7f9fcc06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00d46a0 tx=0x7f9fd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.420+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9fd0059440 con 0x7f9fe00b3720 2024-04-13T02:45:07.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.596+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9fe015db80 con 0x7f9fe00b3720 2024-04-13T02:45:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.599+0000 7f9fc77fe640 1 -- 172.21.15.114:0/526330343 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f9fd0058d40 con 0x7f9fe00b3720 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9fcc06c8f0 msgr2=0x7f9fcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9fcc06c8f0 0x7f9fcc06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00d46a0 tx=0x7f9fd4009040 comp rx=0 tx=0).stop 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 msgr2=0x7f9fe0161c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 0x7f9fe0161c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c3c0 tx=0x7f9fd000c880 comp rx=0 tx=0).stop 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 shutdown_connections 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9fcc06c8f0 0x7f9fcc06edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9fe015ecc0 0x7f9fe0158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9fe00b3c70 0x7f9fe015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 --2- 172.21.15.114:0/526330343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b3720 0x7f9fe0161c60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 >> 172.21.15.114:0/526330343 conn(0x7f9fe0073480 msgr2=0x7f9fe00d38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 shutdown_connections 2024-04-13T02:45:07.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.601+0000 7f9fe561c640 1 -- 172.21.15.114:0/526330343 wait complete. 2024-04-13T02:45:07.613 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-13T02:45:07.613 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-13T02:45:07.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-13T02:45:07.709 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-13T02:45:07.709 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:07.710 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:07.725 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:07.725 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:07.779 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:07.779 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:07.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.973+0000 7f63a7c69640 1 Processor -- start 2024-04-13T02:45:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.973+0000 7f63a7c69640 1 -- start start 2024-04-13T02:45:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a7c69640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a009b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a7c69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a00d20d0 0x7f63a00ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a7c69640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a00d1030 con 0x7f63a006d8f0 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a7c69640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f63a009be50 con 0x7f63a00d20d0 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a7c69640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f63a00d1310 con 0x7f63a006d510 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a6206640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a00d20d0 0x7f63a00ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a6206640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a00d20d0 0x7f63a00ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37896/0 (socket says 172.21.15.114:37896) 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.974+0000 7f63a6206640 1 -- 172.21.15.114:0/3788026251 learned_addr learned my addr 172.21.15.114:0/3788026251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.975+0000 7f63a5a05640 1 --2- 172.21.15.114:0/3788026251 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a009b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.975+0000 7f63a6206640 1 -- 172.21.15.114:0/3788026251 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 msgr2=0x7f63a009b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.975+0000 7f63a6206640 1 --2- 172.21.15.114:0/3788026251 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a009b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.975+0000 7f63a6206640 1 -- 172.21.15.114:0/3788026251 >> v1:172.21.15.130:6789/0 conn(0x7f63a006d8f0 legacy=0x7f63a00d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.975+0000 7f63a6206640 1 -- 172.21.15.114:0/3788026251 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a00d15f0 con 0x7f63a00d20d0 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.975+0000 7f63a6206640 1 --2- 172.21.15.114:0/3788026251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a00d20d0 0x7f63a00ce2a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f63a006fc40 tx=0x7f639802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5318db58bd6f4e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a4a03640 1 -- 172.21.15.114:0/3788026251 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398035020 con 0x7f63a00d20d0 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a4a03640 1 -- 172.21.15.114:0/3788026251 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6398031640 con 0x7f63a00d20d0 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a4a03640 1 -- 172.21.15.114:0/3788026251 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639802d040 con 0x7f63a00d20d0 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 -- 172.21.15.114:0/3788026251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a00d20d0 msgr2=0x7f63a00ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 --2- 172.21.15.114:0/3788026251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a00d20d0 0x7f63a00ce2a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f63a006fc40 tx=0x7f639802b8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 -- 172.21.15.114:0/3788026251 shutdown_connections 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 --2- 172.21.15.114:0/3788026251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a00d20d0 0x7f63a00ce2a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 --2- 172.21.15.114:0/3788026251 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a009b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 -- 172.21.15.114:0/3788026251 >> 172.21.15.114:0/3788026251 conn(0x7f63a00d27c0 msgr2=0x7f63a00d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:07.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 -- 172.21.15.114:0/3788026251 shutdown_connections 2024-04-13T02:45:07.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.976+0000 7f63a7c69640 1 -- 172.21.15.114:0/3788026251 wait complete. 2024-04-13T02:45:07.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.977+0000 7f63a7c69640 1 Processor -- start 2024-04-13T02:45:07.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.977+0000 7f63a7c69640 1 -- start start 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a7c69640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a00c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a7c69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 0x7f63a0152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a7c69640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63a00d20d0 0x7f63a0070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a7c69640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f63a00ce7e0 con 0x7f63a006d8f0 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a7c69640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f63a00d1bb0 con 0x7f63a00d20d0 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a7c69640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f63a00ce960 con 0x7f63a006d510 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 0x7f63a0152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 0x7f63a0152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37902/0 (socket says 172.21.15.114:37902) 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 -- 172.21.15.114:0/1199241345 learned_addr learned my addr 172.21.15.114:0/1199241345 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a6206640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63a00d20d0 0x7f63a0070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5a05640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a00c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 -- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 msgr2=0x7f63a00c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a00c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 -- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63a00d20d0 msgr2=0x7f63a0070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.978+0000 7f63a5204640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63a00d20d0 0x7f63a0070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63a5204640 1 -- 172.21.15.114:0/1199241345 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a00cd570 con 0x7f63a006d8f0 2024-04-13T02:45:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63a5204640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 0x7f63a0152bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f639000c400 tx=0x7f639000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390011790 con 0x7f63a006d8f0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6390017070 con 0x7f63a006d8f0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390011bb0 con 0x7f63a006d8f0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a00cc4d0 con 0x7f63a006d8f0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.979+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a00cca90 con 0x7f63a006d8f0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.980+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a009b1d0 con 0x7f63a006d8f0 2024-04-13T02:45:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.980+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f639001c460 con 0x7f63a006d8f0 2024-04-13T02:45:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.981+0000 7f63967fc640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f638406c920 0x7f638406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.981+0000 7f63a5a05640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f638406c920 0x7f638406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.981+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f639008b910 con 0x7f63a006d8f0 2024-04-13T02:45:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.981+0000 7f63a5a05640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f638406c920 0x7f638406ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f639c009a60 tx=0x7f639c003990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:07.985+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f63a009b1d0 con 0x7f63a006d8f0 2024-04-13T02:45:08.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.160+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63a0068c80 con 0x7f63a006d8f0 2024-04-13T02:45:08.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.161+0000 7f63967fc640 1 -- 172.21.15.114:0/1199241345 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f6390059dd0 con 0x7f63a006d8f0 2024-04-13T02:45:08.162 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:08.162 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f638406c920 msgr2=0x7f638406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f638406c920 0x7f638406ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f639c009a60 tx=0x7f639c003990 comp rx=0 tx=0).stop 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 msgr2=0x7f63a0152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 0x7f63a0152bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f639000c400 tx=0x7f639000c8c0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 shutdown_connections 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f63a00d20d0 0x7f63a0070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a006d8f0 0x7f63a0152bf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f638406c920 0x7f638406ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 --2- 172.21.15.114:0/1199241345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f63a006d510 0x7f63a00c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 >> 172.21.15.114:0/1199241345 conn(0x7f63a00d27c0 msgr2=0x7f63a0070480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 shutdown_connections 2024-04-13T02:45:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.163+0000 7f63a7c69640 1 -- 172.21.15.114:0/1199241345 wait complete. 2024-04-13T02:45:08.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:08.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 Processor -- start 2024-04-13T02:45:08.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 -- start start 2024-04-13T02:45:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc54415ecc0 0x7fc5440d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5440d3270 0x7fc5440b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5440ba4d0 con 0x7fc5440b3720 2024-04-13T02:45:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc54415f0a0 con 0x7fc5440d3270 2024-04-13T02:45:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc54afaa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440ba280 con 0x7fc54415ecc0 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.278+0000 7fc543fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5440d3270 0x7fc5440b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5440d3270 0x7fc5440b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37918/0 (socket says 172.21.15.114:37918) 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 -- 172.21.15.114:0/1188245108 learned_addr learned my addr 172.21.15.114:0/1188245108 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc548d46640 1 --2- 172.21.15.114:0/1188245108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc54415ecc0 0x7fc5440d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 -- 172.21.15.114:0/1188245108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc54415ecc0 msgr2=0x7fc5440d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 --2- 172.21.15.114:0/1188245108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc54415ecc0 0x7fc5440d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 -- 172.21.15.114:0/1188245108 >> v1:172.21.15.130:6789/0 conn(0x7fc5440b3720 legacy=0x7fc5440cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 -- 172.21.15.114:0/1188245108 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5440ba7b0 con 0x7fc5440d3270 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.279+0000 7fc543fff640 1 --2- 172.21.15.114:0/1188245108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5440d3270 0x7fc5440b95f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc538009870 tx=0x7fc53802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaa21878457cdbc server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc5437fe640 1 -- 172.21.15.114:0/1188245108 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538035020 con 0x7fc5440d3270 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc5437fe640 1 -- 172.21.15.114:0/1188245108 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc538031640 con 0x7fc5440d3270 2024-04-13T02:45:08.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc5437fe640 1 -- 172.21.15.114:0/1188245108 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53802d040 con 0x7fc5440d3270 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 -- 172.21.15.114:0/1188245108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5440d3270 msgr2=0x7fc5440b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 --2- 172.21.15.114:0/1188245108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5440d3270 0x7fc5440b95f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc538009870 tx=0x7fc53802b8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 -- 172.21.15.114:0/1188245108 shutdown_connections 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 --2- 172.21.15.114:0/1188245108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5440d3270 0x7fc5440b95f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 --2- 172.21.15.114:0/1188245108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc54415ecc0 0x7fc5440d2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 -- 172.21.15.114:0/1188245108 >> 172.21.15.114:0/1188245108 conn(0x7fc544073480 msgr2=0x7fc544073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 -- 172.21.15.114:0/1188245108 shutdown_connections 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.280+0000 7fc54afaa640 1 -- 172.21.15.114:0/1188245108 wait complete. 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.281+0000 7fc54afaa640 1 Processor -- start 2024-04-13T02:45:08.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.281+0000 7fc54afaa640 1 -- start start 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc54afaa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5440b3720 0x7fc5440ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc54afaa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5440d3270 0x7fc544160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc54afaa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 0x7fc5441606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc54afaa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440b8aa0 con 0x7fc54415ecc0 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc54afaa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440b90d0 con 0x7fc5440b3720 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc54afaa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440cfdb0 con 0x7fc5440d3270 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc549547640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 0x7fc5441606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc549547640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 0x7fc5441606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37930/0 (socket says 172.21.15.114:37930) 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc549547640 1 -- 172.21.15.114:0/2503539477 learned_addr learned my addr 172.21.15.114:0/2503539477 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc548d46640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5440b3720 0x7fc5440ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.282+0000 7fc543fff640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5440d3270 0x7fc544160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc549547640 1 -- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5440d3270 msgr2=0x7fc544160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc549547640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5440d3270 0x7fc544160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc549547640 1 -- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5440b3720 msgr2=0x7fc5440ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc549547640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5440b3720 0x7fc5440ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc549547640 1 -- 172.21.15.114:0/2503539477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54415f3a0 con 0x7fc54415ecc0 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc548d46640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5440b3720 0x7fc5440ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc549547640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 0x7fc5441606a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00c7a0 tx=0x7fc53c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c016020 con 0x7fc54415ecc0 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c00aa50 con 0x7fc54415ecc0 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00ae40 con 0x7fc54415ecc0 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54415f680 con 0x7fc54415ecc0 2024-04-13T02:45:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.283+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54415fc40 con 0x7fc54415ecc0 2024-04-13T02:45:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.284+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5440cb6f0 con 0x7fc54415ecc0 2024-04-13T02:45:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.284+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc53c019020 con 0x7fc54415ecc0 2024-04-13T02:45:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.285+0000 7fc5417fa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.285+0000 7fc548d46640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.285+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc53c08b5d0 con 0x7fc54415ecc0 2024-04-13T02:45:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.285+0000 7fc548d46640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc53006c8f0 0x7fc53006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc534008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.289+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5440cb6f0 con 0x7fc54415ecc0 2024-04-13T02:45:08.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.465+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc5440b6fe0 con 0x7fc54415ecc0 2024-04-13T02:45:08.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.465+0000 7fc5417fa640 1 -- 172.21.15.114:0/2503539477 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc5440b6fe0 con 0x7fc54415ecc0 2024-04-13T02:45:08.466 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:08.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc53006c8f0 msgr2=0x7fc53006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc53006c8f0 0x7fc53006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc534008040 comp rx=0 tx=0).stop 2024-04-13T02:45:08.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 msgr2=0x7fc5441606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 0x7fc5441606a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00c7a0 tx=0x7fc53c00cc60 comp rx=0 tx=0).stop 2024-04-13T02:45:08.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 shutdown_connections 2024-04-13T02:45:08.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc54415ecc0 0x7fc5441606a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5440d3270 0x7fc544160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 --2- 172.21.15.114:0/2503539477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5440b3720 0x7fc5440ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 >> 172.21.15.114:0/2503539477 conn(0x7fc544073480 msgr2=0x7fc5440b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:08.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 shutdown_connections 2024-04-13T02:45:08.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.467+0000 7fc54afaa640 1 -- 172.21.15.114:0/2503539477 wait complete. 2024-04-13T02:45:08.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.580+0000 7eff4480f640 1 Processor -- start 2024-04-13T02:45:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.580+0000 7eff4480f640 1 -- start start 2024-04-13T02:45:08.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff4480f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff40160050 0x7eff40071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff4480f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff40072150 0x7eff400d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff4480f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4009b740 con 0x7eff400d0e50 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff4480f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7eff400cd4d0 con 0x7eff40072150 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff4480f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7eff400d3660 con 0x7eff40160050 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff3dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff40072150 0x7eff400d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff3ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7eff400d0e50 0x7eff40070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38908/0 (socket says 172.21.15.114:38908) 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.581+0000 7eff3ed9d640 1 -- 172.21.15.114:0/2995114805 learned_addr learned my addr 172.21.15.114:0/2995114805 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.582+0000 7eff3dd9b640 1 -- 172.21.15.114:0/2995114805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff40160050 msgr2=0x7eff40071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.582+0000 7eff3dd9b640 1 --2- 172.21.15.114:0/2995114805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff40160050 0x7eff40071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.582+0000 7eff3dd9b640 1 -- 172.21.15.114:0/2995114805 >> v1:172.21.15.114:6789/0 conn(0x7eff400d0e50 legacy=0x7eff40070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.582+0000 7eff3d59a640 1 -- 172.21.15.114:0/2995114805 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611436885 0 0) 0x7eff4009b740 con 0x7eff400d0e50 2024-04-13T02:45:08.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.582+0000 7eff3dd9b640 1 -- 172.21.15.114:0/2995114805 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff40160430 con 0x7eff40072150 2024-04-13T02:45:08.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.582+0000 7eff3dd9b640 1 --2- 172.21.15.114:0/2995114805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff400d0910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7eff340097a0 tx=0x7eff3402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d95ddaeddc353a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff3d59a640 1 -- 172.21.15.114:0/2995114805 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34038070 con 0x7eff40072150 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff3d59a640 1 -- 172.21.15.114:0/2995114805 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff34031700 con 0x7eff40072150 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff3d59a640 1 -- 172.21.15.114:0/2995114805 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34031ad0 con 0x7eff40072150 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 -- 172.21.15.114:0/2995114805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 msgr2=0x7eff400d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 --2- 172.21.15.114:0/2995114805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff400d0910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7eff340097a0 tx=0x7eff3402b7a0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 -- 172.21.15.114:0/2995114805 shutdown_connections 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 --2- 172.21.15.114:0/2995114805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff400d0910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 --2- 172.21.15.114:0/2995114805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff40160050 0x7eff40071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 -- 172.21.15.114:0/2995114805 >> 172.21.15.114:0/2995114805 conn(0x7eff400d2750 msgr2=0x7eff400d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 -- 172.21.15.114:0/2995114805 shutdown_connections 2024-04-13T02:45:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.583+0000 7eff4480f640 1 -- 172.21.15.114:0/2995114805 wait complete. 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.584+0000 7eff4480f640 1 Processor -- start 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 -- start start 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff4014c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff400d0e50 0x7eff4014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff40160050 0x7eff4014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7eff400cd0f0 con 0x7eff40072150 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff4009bcc0 con 0x7eff40160050 2024-04-13T02:45:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff4480f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7eff400ce970 con 0x7eff400d0e50 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff3e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff4014c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff3e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff4014c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37938/0 (socket says 172.21.15.114:37938) 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.585+0000 7eff3e59c640 1 -- 172.21.15.114:0/2000339310 learned_addr learned my addr 172.21.15.114:0/2000339310 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3dd9b640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff400d0e50 0x7eff4014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3e59c640 1 -- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff400d0e50 msgr2=0x7eff4014cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3ed9d640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff40160050 0x7eff4014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3e59c640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff400d0e50 0x7eff4014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3e59c640 1 -- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff40160050 msgr2=0x7eff4014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3e59c640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff40160050 0x7eff4014d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3e59c640 1 -- 172.21.15.114:0/2000339310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4014f110 con 0x7eff40072150 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3ed9d640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff40160050 0x7eff4014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff3e59c640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff4014c510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff3000ba50 tx=0x7eff3000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30019070 con 0x7eff40072150 2024-04-13T02:45:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3000cc00 con 0x7eff40072150 2024-04-13T02:45:08.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4014ca50 con 0x7eff40072150 2024-04-13T02:45:08.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30014440 con 0x7eff40072150 2024-04-13T02:45:08.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.586+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4014dbd0 con 0x7eff40072150 2024-04-13T02:45:08.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.587+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40069170 con 0x7eff40072150 2024-04-13T02:45:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.587+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff3001c070 con 0x7eff40072150 2024-04-13T02:45:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.588+0000 7eff2effd640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7eff2006c8f0 0x7eff2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.588+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7eff3008b910 con 0x7eff40072150 2024-04-13T02:45:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.588+0000 7eff3dd9b640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7eff2006c8f0 0x7eff2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.588+0000 7eff3dd9b640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7eff2006c8f0 0x7eff2006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff34035000 tx=0x7eff34008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.592+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff40069170 con 0x7eff40072150 2024-04-13T02:45:08.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.768+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7eff400b40b0 con 0x7eff40072150 2024-04-13T02:45:08.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.768+0000 7eff2effd640 1 -- 172.21.15.114:0/2000339310 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7eff400b40b0 con 0x7eff40072150 2024-04-13T02:45:08.769 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:08.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7eff2006c8f0 msgr2=0x7eff2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7eff2006c8f0 0x7eff2006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff34035000 tx=0x7eff34008030 comp rx=0 tx=0).stop 2024-04-13T02:45:08.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 msgr2=0x7eff4014c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff4014c510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff3000ba50 tx=0x7eff3000bf10 comp rx=0 tx=0).stop 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 shutdown_connections 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff40160050 0x7eff4014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7eff2006c8f0 0x7eff2006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff400d0e50 0x7eff4014cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 --2- 172.21.15.114:0/2000339310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff40072150 0x7eff4014c510 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 >> 172.21.15.114:0/2000339310 conn(0x7eff400d2750 msgr2=0x7eff4015ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 shutdown_connections 2024-04-13T02:45:08.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.770+0000 7eff4480f640 1 -- 172.21.15.114:0/2000339310 wait complete. 2024-04-13T02:45:08.782 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:08.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.884+0000 7f05ea636640 1 Processor -- start 2024-04-13T02:45:08.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.884+0000 7f05ea636640 1 -- start start 2024-04-13T02:45:08.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05ea636640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05e415d0e0 0x7f05e40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05ea636640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e406f890 con 0x7f05e406b930 2024-04-13T02:45:08.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05ea636640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e4067e90 con 0x7f05e40ce4c0 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05ea636640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40ce030 con 0x7f05e415d0e0 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e8bd3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f05e406b930 0x7f05e406bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48588/0 (socket says 172.21.15.114:48588) 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e8bd3640 1 -- 172.21.15.114:0/2809875731 learned_addr learned my addr 172.21.15.114:0/2809875731 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e3fff640 1 --2- 172.21.15.114:0/2809875731 >> v2:172.21.15.130:3300/0 conn(0x7f05e415d0e0 0x7f05e40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186250910 0 0) 0x7f05e406f890 con 0x7f05e406b930 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05cc003520 con 0x7f05e406b930 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3053827639 0 0) 0x7f05cc003520 con 0x7f05e406b930 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 >> v2:172.21.15.130:3300/0 conn(0x7f05e415d0e0 msgr2=0x7f05e40cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 --2- 172.21.15.114:0/2809875731 >> v2:172.21.15.130:3300/0 conn(0x7f05e415d0e0 0x7f05e40cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 >> v1:172.21.15.130:6789/0 conn(0x7f05e40ce4c0 legacy=0x7f05e415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4068170 con 0x7f05e406b930 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f05dc0019f0 con 0x7f05e406b930 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 >> v1:172.21.15.114:6789/0 conn(0x7f05e406b930 legacy=0x7f05e406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05cc0039b0 0x7f05cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc004800 0x7f05cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05cc0051c0 0x7f05cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40ce030 con 0x7f05cc0039b0 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc00c060 con 0x7f05cc0051c0 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05cc00c260 con 0x7f05cc004800 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e3fff640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05cc0039b0 0x7f05cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.885+0000 7f05e8bd3640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05cc0051c0 0x7f05cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e37fe640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc004800 0x7f05cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e3fff640 1 -- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc004800 msgr2=0x7f05cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e3fff640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc004800 0x7f05cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e3fff640 1 -- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05cc0051c0 msgr2=0x7f05cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e3fff640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05cc0051c0 0x7f05cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e3fff640 1 -- 172.21.15.114:0/2809875731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc003520 con 0x7f05cc0039b0 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e8bd3640 1 -- 172.21.15.114:0/2809875731 reap_dead start 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e37fe640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc004800 0x7f05cc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.886+0000 7f05e3fff640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05cc0039b0 0x7f05cc003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009650 tx=0x7f05cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac50c7d729d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d803d070 con 0x7f05cc0039b0 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8030ac0 con 0x7f05cc0039b0 2024-04-13T02:45:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05e2ffd640 1 -- 172.21.15.114:0/2809875731 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8009690 con 0x7f05cc0039b0 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 -- 172.21.15.114:0/2809875731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05cc0039b0 msgr2=0x7f05cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05cc0039b0 0x7f05cc003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009650 tx=0x7f05cc005830 comp rx=0 tx=0).stop 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 -- 172.21.15.114:0/2809875731 shutdown_connections 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 --2- 172.21.15.114:0/2809875731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05cc0039b0 0x7f05cc003dd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 -- 172.21.15.114:0/2809875731 >> 172.21.15.114:0/2809875731 conn(0x7f05e406ea10 msgr2=0x7f05e406ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 -- 172.21.15.114:0/2809875731 shutdown_connections 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.887+0000 7f05ea636640 1 -- 172.21.15.114:0/2809875731 wait complete. 2024-04-13T02:45:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.888+0000 7f05ea636640 1 Processor -- start 2024-04-13T02:45:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.888+0000 7f05ea636640 1 -- start start 2024-04-13T02:45:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05ea636640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc0039b0 0x7f05e414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05ea636640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 0x7f05e4150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05ea636640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4150b60 0x7f05e4139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05ea636640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40ce940 con 0x7f05e4151e60 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05ea636640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40cdcc0 con 0x7f05e4150b60 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05ea636640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05e40ceac0 con 0x7f05cc0039b0 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 0x7f05e4150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 0x7f05e4150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34280/0 (socket says 172.21.15.114:34280) 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05e37fe640 1 -- 172.21.15.114:0/3585491137 learned_addr learned my addr 172.21.15.114:0/3585491137 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05e8bd3640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4150b60 0x7f05e4139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.889+0000 7f05e3fff640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc0039b0 0x7f05e414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e37fe640 1 -- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc0039b0 msgr2=0x7f05e414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e37fe640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc0039b0 0x7f05e414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e37fe640 1 -- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4150b60 msgr2=0x7f05e4139700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e37fe640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4150b60 0x7f05e4139700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e37fe640 1 -- 172.21.15.114:0/3585491137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4152600 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e3fff640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc0039b0 0x7f05e414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e37fe640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 0x7f05e4150620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f05d400d4a0 tx=0x7f05d400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4019070 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4005480 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e41528e0 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4007230 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.890+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e4152ea0 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.891+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e4068c80 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.891+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05d401c060 con 0x7f05e4151e60 2024-04-13T02:45:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.892+0000 7f05e0ff9640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f05d006c920 0x7f05d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.892+0000 7f05e3fff640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f05d006c920 0x7f05d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.892+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f05d408b1f0 con 0x7f05e4151e60 2024-04-13T02:45:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.892+0000 7f05e3fff640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f05d006c920 0x7f05d006ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05d803a000 tx=0x7f05d8034000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:08.896+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05d4058f50 con 0x7f05e4151e60 2024-04-13T02:45:09.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.070+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f05e4155480 con 0x7f05e4151e60 2024-04-13T02:45:09.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.070+0000 7f05e0ff9640 1 -- 172.21.15.114:0/3585491137 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f05d405d250 con 0x7f05e4151e60 2024-04-13T02:45:09.072 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f05d006c920 msgr2=0x7f05d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f05d006c920 0x7f05d006ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f05d803a000 tx=0x7f05d8034000 comp rx=0 tx=0).stop 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 msgr2=0x7f05e4150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 0x7f05e4150620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f05d400d4a0 tx=0x7f05d400d960 comp rx=0 tx=0).stop 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 shutdown_connections 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4150b60 0x7f05e4139700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e4151e60 0x7f05e4150620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f05d006c920 0x7f05d006ede0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 --2- 172.21.15.114:0/3585491137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05cc0039b0 0x7f05e414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.072+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 >> 172.21.15.114:0/3585491137 conn(0x7f05e406ea10 msgr2=0x7f05e41542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.073+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 shutdown_connections 2024-04-13T02:45:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.073+0000 7f05ea636640 1 -- 172.21.15.114:0/3585491137 wait complete. 2024-04-13T02:45:09.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T02:45:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.184+0000 7f979c0de640 1 Processor -- start 2024-04-13T02:45:09.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f979c0de640 1 -- start start 2024-04-13T02:45:09.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f979c0de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97940cebc0 0x7f97941610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f979c0de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f97940cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f979c0de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97940b23a0 con 0x7f97940b3df0 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f979c0de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f97940b2150 con 0x7f97940cebc0 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f979c0de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f97940b2fb0 con 0x7f979409b230 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f9799679640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f97940b3df0 0x7f979409ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48590/0 (socket says 172.21.15.114:48590) 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.185+0000 7f9799679640 1 -- 172.21.15.114:0/2036093240 learned_addr learned my addr 172.21.15.114:0/2036093240 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984609396 0 0) 0x7f97940b23a0 con 0x7f97940b3df0 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9780003520 con 0x7f97940b3df0 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9799e7a640 1 --2- 172.21.15.114:0/2036093240 >> v2:172.21.15.130:3300/0 conn(0x7f97940cebc0 0x7f97941610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1492151805 0 0) 0x7f9780003520 con 0x7f97940b3df0 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 msgr2=0x7f97940cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:09.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f97940cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f97940cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 >> v2:172.21.15.130:3300/0 conn(0x7f97940cebc0 msgr2=0x7f97941610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 --2- 172.21.15.114:0/2036093240 >> v2:172.21.15.130:3300/0 conn(0x7f97940cebc0 0x7f97941610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97940b2680 con 0x7f97940b3df0 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f9790001670 con 0x7f97940b3df0 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f97940cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 >> v1:172.21.15.114:6789/0 conn(0x7f97940b3df0 legacy=0x7f979409ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97800039b0 0x7f9780003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f9780004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9780004d40 0x7f97800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97940b2150 con 0x7f9780004d40 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97940b2fb0 con 0x7f97800039b0 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f978000bb50 con 0x7f979409b230 2024-04-13T02:45:09.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9780004d40 0x7f97800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9799e7a640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97800039b0 0x7f9780003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f9799679640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f9780004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 -- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 msgr2=0x7f9780004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f979409b230 0x7f9780004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 -- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97800039b0 msgr2=0x7f9780003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97800039b0 0x7f9780003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.186+0000 7f979a67b640 1 -- 172.21.15.114:0/2036093240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9780003520 con 0x7f9780004d40 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.187+0000 7f979a67b640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9780004d40 0x7f97800051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f97940b3cf0 tx=0x7f9780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca1fcf92b4938d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.187+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c007c20 con 0x7f9780004d40 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.187+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c0345f0 con 0x7f9780004d40 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.187+0000 7f9798e78640 1 -- 172.21.15.114:0/2036093240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c0349e0 con 0x7f9780004d40 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979c0de640 1 -- 172.21.15.114:0/2036093240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9780004d40 msgr2=0x7f97800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979c0de640 1 --2- 172.21.15.114:0/2036093240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9780004d40 0x7f97800051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f97940b3cf0 tx=0x7f9780005830 comp rx=0 tx=0).stop 2024-04-13T02:45:09.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979a67b640 1 -- 172.21.15.114:0/2036093240 reap_dead start 2024-04-13T02:45:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979c0de640 1 -- 172.21.15.114:0/2036093240 shutdown_connections 2024-04-13T02:45:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979c0de640 1 -- 172.21.15.114:0/2036093240 >> 172.21.15.114:0/2036093240 conn(0x7f97940d2800 msgr2=0x7f97940d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979c0de640 1 -- 172.21.15.114:0/2036093240 shutdown_connections 2024-04-13T02:45:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.188+0000 7f979c0de640 1 -- 172.21.15.114:0/2036093240 wait complete. 2024-04-13T02:45:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.189+0000 7f979c0de640 1 Processor -- start 2024-04-13T02:45:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.189+0000 7f979c0de640 1 -- start start 2024-04-13T02:45:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9780004d40 0x7f9794154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9794157910 0x7f97940cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 0x7f979415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97940b2c40 con 0x7f9794154c80 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9794161610 con 0x7f9794157910 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f97940cefa0 con 0x7f9780004d40 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 0x7f979415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 0x7f979415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34292/0 (socket says 172.21.15.114:34292) 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 -- 172.21.15.114:0/3710751317 learned_addr learned my addr 172.21.15.114:0/3710751317 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f9799679640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9794157910 0x7f97940cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f9799e7a640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9780004d40 0x7f9794154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 -- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9780004d40 msgr2=0x7f9794154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9780004d40 0x7f9794154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 -- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9794157910 msgr2=0x7f97940cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9794157910 0x7f97940cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 -- 172.21.15.114:0/3710751317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97940cbba0 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979a67b640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 0x7f979415cc10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c550 tx=0x7f978c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c043030 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c0343f0 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97940cbe40 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c007c20 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.190+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97940cc400 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.191+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9794068c80 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.192+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f978c0338d0 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.192+0000 7f978a7fc640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f977806c8f0 0x7f977806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.192+0000 7f9799e7a640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f977806c8f0 0x7f977806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.192+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f978c0ae950 con 0x7f9794154c80 2024-04-13T02:45:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.193+0000 7f9799e7a640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f977806c8f0 0x7f977806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f979409b0e0 tx=0x7f9784008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:09.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.197+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f978c04d030 con 0x7f9794154c80 2024-04-13T02:45:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.385+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f97940d3540 con 0x7f9794154c80 2024-04-13T02:45:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.385+0000 7f978a7fc640 1 -- 172.21.15.114:0/3710751317 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f978c031070 con 0x7f9794154c80 2024-04-13T02:45:09.386 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-13T02:45:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f977806c8f0 msgr2=0x7f977806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f977806c8f0 0x7f977806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f979409b0e0 tx=0x7f9784008040 comp rx=0 tx=0).stop 2024-04-13T02:45:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 msgr2=0x7f979415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 0x7f979415cc10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c550 tx=0x7f978c004ab0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 shutdown_connections 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9794154c80 0x7f979415cc10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9794157910 0x7f97940cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f977806c8f0 0x7f977806edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 --2- 172.21.15.114:0/3710751317 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9780004d40 0x7f9794154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 >> 172.21.15.114:0/3710751317 conn(0x7f97940d2800 msgr2=0x7f97940d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 shutdown_connections 2024-04-13T02:45:09.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.387+0000 7f979c0de640 1 -- 172.21.15.114:0/3710751317 wait complete. 2024-04-13T02:45:09.399 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-13T02:45:09.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:09.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-13T02:45:09.426 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:45:09.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:09.427 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-13T02:45:09.497 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:09.497 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:09.516 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:09.516 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:09.574 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:09.574 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:09.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.733+0000 7f8d6c8de640 1 Processor -- start 2024-04-13T02:45:09.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.733+0000 7f8d6c8de640 1 -- start start 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6c8de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d680b1200 0x7f8d680af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6c8de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d680af5d0 0x7f8d6815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6c8de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d680b26f0 con 0x7f8d68146310 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6c8de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8d681466f0 con 0x7f8d680af5d0 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6c8de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8d680afa20 con 0x7f8d680b1200 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d66d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d680af5d0 0x7f8d6815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8d68146310 0x7f8d680b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48604/0 (socket says 172.21.15.114:48604) 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6659c640 1 -- 172.21.15.114:0/3995449495 learned_addr learned my addr 172.21.15.114:0/3995449495 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d65d9b640 1 --2- 172.21.15.114:0/3995449495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d680b1200 0x7f8d680af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d66d9d640 1 -- 172.21.15.114:0/3995449495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d680b1200 msgr2=0x7f8d680af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d66d9d640 1 --2- 172.21.15.114:0/3995449495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d680b1200 0x7f8d680af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d66d9d640 1 -- 172.21.15.114:0/3995449495 >> v1:172.21.15.114:6789/0 conn(0x7f8d68146310 legacy=0x7f8d680b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d6559a640 1 -- 172.21.15.114:0/3995449495 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558815787 0 0) 0x7f8d58001490 con 0x7f8d68146310 2024-04-13T02:45:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.734+0000 7f8d66d9d640 1 -- 172.21.15.114:0/3995449495 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d680b2970 con 0x7f8d680af5d0 2024-04-13T02:45:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.735+0000 7f8d66d9d640 1 --2- 172.21.15.114:0/3995449495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6815d4e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d600097a0 tx=0x7f8d6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88127149454f7138 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.735+0000 7f8d6559a640 1 -- 172.21.15.114:0/3995449495 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60035020 con 0x7f8d680af5d0 2024-04-13T02:45:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.735+0000 7f8d6559a640 1 -- 172.21.15.114:0/3995449495 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d60031830 con 0x7f8d680af5d0 2024-04-13T02:45:09.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.735+0000 7f8d6559a640 1 -- 172.21.15.114:0/3995449495 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60031c00 con 0x7f8d680af5d0 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 -- 172.21.15.114:0/3995449495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 msgr2=0x7f8d6815d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/3995449495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6815d4e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d600097a0 tx=0x7f8d6002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 -- 172.21.15.114:0/3995449495 shutdown_connections 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/3995449495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6815d4e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/3995449495 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d680b1200 0x7f8d680af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 -- 172.21.15.114:0/3995449495 >> 172.21.15.114:0/3995449495 conn(0x7f8d680b6f50 msgr2=0x7f8d6809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 -- 172.21.15.114:0/3995449495 shutdown_connections 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.736+0000 7f8d6c8de640 1 -- 172.21.15.114:0/3995449495 wait complete. 2024-04-13T02:45:09.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.737+0000 7f8d6c8de640 1 Processor -- start 2024-04-13T02:45:09.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.737+0000 7f8d6c8de640 1 -- start start 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6c8de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6813e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6c8de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d680b1200 0x7f8d6815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6c8de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d68146310 0x7f8d6809e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6c8de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680b3210 con 0x7f8d680af5d0 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6c8de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680b2f30 con 0x7f8d680b1200 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6c8de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6815cf10 con 0x7f8d68146310 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6813e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6813e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34304/0 (socket says 172.21.15.114:34304) 2024-04-13T02:45:09.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 -- 172.21.15.114:0/4066845799 learned_addr learned my addr 172.21.15.114:0/4066845799 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 -- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d68146310 msgr2=0x7f8d6809e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d66d9d640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d68146310 0x7f8d6809e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d65d9b640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d680b1200 0x7f8d6815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d68146310 0x7f8d6809e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 -- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d680b1200 msgr2=0x7f8d6815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d680b1200 0x7f8d6815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 -- 172.21.15.114:0/4066845799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6813d7b0 con 0x7f8d680af5d0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d66d9d640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d68146310 0x7f8d6809e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.738+0000 7f8d6659c640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6813e850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800c7c0 tx=0x7f8d5800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.739+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58018070 con 0x7f8d680af5d0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.739+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5800a640 con 0x7f8d680af5d0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.739+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6813da90 con 0x7f8d680af5d0 2024-04-13T02:45:09.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.739+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800aa30 con 0x7f8d680af5d0 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.739+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6813e050 con 0x7f8d680af5d0 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.740+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d68068c80 con 0x7f8d680af5d0 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.740+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d5801b070 con 0x7f8d680af5d0 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.740+0000 7f8d56ffd640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8d4806c8f0 0x7f8d4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.741+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d5808b190 con 0x7f8d680af5d0 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.741+0000 7f8d65d9b640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8d4806c8f0 0x7f8d4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:09.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.741+0000 7f8d65d9b640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8d4806c8f0 0x7f8d4806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c006fd0 tx=0x7f8d5c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:09.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.745+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d680b26f0 con 0x7f8d680af5d0 2024-04-13T02:45:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.919+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d680b2100 con 0x7f8d680af5d0 2024-04-13T02:45:09.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.920+0000 7f8d56ffd640 1 -- 172.21.15.114:0/4066845799 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f8d580595c0 con 0x7f8d680af5d0 2024-04-13T02:45:09.921 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:09.922 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:09.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8d4806c8f0 msgr2=0x7f8d4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8d4806c8f0 0x7f8d4806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c006fd0 tx=0x7f8d5c008040 comp rx=0 tx=0).stop 2024-04-13T02:45:09.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 msgr2=0x7f8d6813e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6813e850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800c7c0 tx=0x7f8d5800cc80 comp rx=0 tx=0).stop 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 shutdown_connections 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8d4806c8f0 0x7f8d4806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8d68146310 0x7f8d6809e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d680b1200 0x7f8d6815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 --2- 172.21.15.114:0/4066845799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d680af5d0 0x7f8d6813e850 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 >> 172.21.15.114:0/4066845799 conn(0x7f8d680b6f50 msgr2=0x7f8d6809f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 shutdown_connections 2024-04-13T02:45:09.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:09.922+0000 7f8d6c8de640 1 -- 172.21.15.114:0/4066845799 wait complete. 2024-04-13T02:45:09.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:09.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.037+0000 7fcea211e640 1 Processor -- start 2024-04-13T02:45:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.037+0000 7fcea211e640 1 -- start start 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fcea211e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 0x7fce9c0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fcea211e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c071330 con 0x7fce9c0ce650 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fcea211e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9c06cae0 con 0x7fce9c06e2f0 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fcea211e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c09bb40 con 0x7fce9c09b230 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fce9c0ce650 0x7fce9c09ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48618/0 (socket says 172.21.15.114:48618) 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9b7fe640 1 -- 172.21.15.114:0/2272005805 learned_addr learned my addr 172.21.15.114:0/2272005805 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9affd640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 0x7fce9c0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432390448 0 0) 0x7fce9c071330 con 0x7fce9c0ce650 2024-04-13T02:45:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce84003520 con 0x7fce9c0ce650 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222065564 0 0) 0x7fce84003520 con 0x7fce9c0ce650 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 msgr2=0x7fce9c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 0x7fce9c0d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 >> v1:172.21.15.130:6789/0 conn(0x7fce9c06e2f0 legacy=0x7fce9c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c06e9f0 con 0x7fce9c0ce650 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fce8c001670 con 0x7fce9c0ce650 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 >> v1:172.21.15.114:6789/0 conn(0x7fce9c0ce650 legacy=0x7fce9c09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce840039e0 0x7fce84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce84004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 0x7fce840050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c09bb40 con 0x7fce84004390 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce8400b9c0 con 0x7fce840039e0 2024-04-13T02:45:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.038+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fce8400bbc0 con 0x7fce9c09b230 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9affd640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce84004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9b7fe640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce840039e0 0x7fce84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9bfff640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 0x7fce840050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9affd640 1 -- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 msgr2=0x7fce840050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9affd640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c09b230 0x7fce840050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9affd640 1 -- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce840039e0 msgr2=0x7fce84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9affd640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce840039e0 0x7fce84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.039+0000 7fce9affd640 1 -- 172.21.15.114:0/2272005805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce84003520 con 0x7fce84004390 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fce9affd640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce84004860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fce90009ac0 tx=0x7fce84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b6f6521ef280e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90039070 con 0x7fce84004390 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9002c6b0 con 0x7fce84004390 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fce9a7fc640 1 -- 172.21.15.114:0/2272005805 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90009690 con 0x7fce84004390 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fcea211e640 1 -- 172.21.15.114:0/2272005805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 msgr2=0x7fce84004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fcea211e640 1 --2- 172.21.15.114:0/2272005805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce84004860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fce90009ac0 tx=0x7fce84005830 comp rx=0 tx=0).stop 2024-04-13T02:45:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fce9bfff640 1 -- 172.21.15.114:0/2272005805 reap_dead start 2024-04-13T02:45:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fcea211e640 1 -- 172.21.15.114:0/2272005805 shutdown_connections 2024-04-13T02:45:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fcea211e640 1 -- 172.21.15.114:0/2272005805 >> 172.21.15.114:0/2272005805 conn(0x7fce9c0d2720 msgr2=0x7fce9c0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fcea211e640 1 -- 172.21.15.114:0/2272005805 shutdown_connections 2024-04-13T02:45:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.040+0000 7fcea211e640 1 -- 172.21.15.114:0/2272005805 wait complete. 2024-04-13T02:45:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.041+0000 7fcea211e640 1 Processor -- start 2024-04-13T02:45:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 -- start start 2024-04-13T02:45:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce9c1e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c1526b0 0x7fce9c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce9c0c9ab0 0x7fce9c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c09bd90 con 0x7fce84004390 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c06ce50 con 0x7fce9c0c9ab0 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fcea211e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0cea30 con 0x7fce9c1526b0 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fce9b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce9c1e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fce9b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce9c1e53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34310/0 (socket says 172.21.15.114:34310) 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.042+0000 7fce9b7fe640 1 -- 172.21.15.114:0/1631996548 learned_addr learned my addr 172.21.15.114:0/1631996548 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9b7fe640 1 -- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c1526b0 msgr2=0x7fce9c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9b7fe640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c1526b0 0x7fce9c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9b7fe640 1 -- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce9c0c9ab0 msgr2=0x7fce9c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9bfff640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce9c0c9ab0 0x7fce9c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9b7fe640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce9c0c9ab0 0x7fce9c0c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9b7fe640 1 -- 172.21.15.114:0/1631996548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c0ca850 con 0x7fce84004390 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce9b7fe640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce9c1e53e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce8c004fc0 tx=0x7fce8c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007740 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c018070 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00fc00 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c0cab30 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.043+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c0cb0f0 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.044+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c0d0390 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.044+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce8c01d460 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.045+0000 7fce83fff640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fce8806ca90 0x7fce8806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.045+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce8c08bb60 con 0x7fce84004390 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.045+0000 7fce9affd640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fce8806ca90 0x7fce8806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.045+0000 7fce9affd640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fce8806ca90 0x7fce8806ef50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce90009ac0 tx=0x7fce9002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.049+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce9c0d0390 con 0x7fce84004390 2024-04-13T02:45:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.223+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce9c068c60 con 0x7fce84004390 2024-04-13T02:45:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.223+0000 7fce83fff640 1 -- 172.21.15.114:0/1631996548 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fce8c05a020 con 0x7fce84004390 2024-04-13T02:45:10.224 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fce8806ca90 msgr2=0x7fce8806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fce8806ca90 0x7fce8806ef50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce90009ac0 tx=0x7fce9002e000 comp rx=0 tx=0).stop 2024-04-13T02:45:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 msgr2=0x7fce9c1e53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce9c1e53e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce8c004fc0 tx=0x7fce8c0074f0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 shutdown_connections 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce9c0c9ab0 0x7fce9c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fce8806ca90 0x7fce8806ef50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce9c1526b0 0x7fce9c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 --2- 172.21.15.114:0/1631996548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce84004390 0x7fce9c1e53e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.225+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 >> 172.21.15.114:0/1631996548 conn(0x7fce9c0d2720 msgr2=0x7fce9c0b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.226+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 shutdown_connections 2024-04-13T02:45:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.226+0000 7fcea211e640 1 -- 172.21.15.114:0/1631996548 wait complete. 2024-04-13T02:45:10.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.340+0000 7fe7031e9640 1 Processor -- start 2024-04-13T02:45:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.340+0000 7fe7031e9640 1 -- start start 2024-04-13T02:45:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe7031e9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6fc06e2f0 0x7fe6fc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe7031e9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc071330 con 0x7fe6fc0ce650 2024-04-13T02:45:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe7031e9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc06cae0 con 0x7fe6fc09b230 2024-04-13T02:45:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe7031e9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc09bb40 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe701786640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6fc06e2f0 0x7fe6fc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe700f85640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe6fc0ce650 0x7fe6fc09ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48628/0 (socket says 172.21.15.114:48628) 2024-04-13T02:45:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe700f85640 1 -- 172.21.15.114:0/3559886944 learned_addr learned my addr 172.21.15.114:0/3559886944 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe701786640 1 -- 172.21.15.114:0/3559886944 >> v1:172.21.15.130:6789/0 conn(0x7fe6fc09b230 legacy=0x7fe6fc0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe701786640 1 -- 172.21.15.114:0/3559886944 >> v1:172.21.15.114:6789/0 conn(0x7fe6fc0ce650 legacy=0x7fe6fc09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe701786640 1 -- 172.21.15.114:0/3559886944 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc06e9f0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.341+0000 7fe6fb7fe640 1 -- 172.21.15.114:0/3559886944 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671759619 0 0) 0x7fe6fc071330 con 0x7fe6fc0ce650 2024-04-13T02:45:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.342+0000 7fe701786640 1 --2- 172.21.15.114:0/3559886944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc0d0ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009d90 tx=0x7fe6f402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba867b29bbe8e4a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.342+0000 7fe6fb7fe640 1 -- 172.21.15.114:0/3559886944 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4039070 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.342+0000 7fe6fb7fe640 1 -- 172.21.15.114:0/3559886944 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f402cd00 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.342+0000 7fe6fb7fe640 1 -- 172.21.15.114:0/3559886944 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4034660 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 -- 172.21.15.114:0/3559886944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 msgr2=0x7fe6fc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 --2- 172.21.15.114:0/3559886944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc0d0ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009d90 tx=0x7fe6f402bf50 comp rx=0 tx=0).stop 2024-04-13T02:45:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 -- 172.21.15.114:0/3559886944 shutdown_connections 2024-04-13T02:45:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 --2- 172.21.15.114:0/3559886944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc0d0ec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 -- 172.21.15.114:0/3559886944 >> 172.21.15.114:0/3559886944 conn(0x7fe6fc0d2720 msgr2=0x7fe6fc0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 -- 172.21.15.114:0/3559886944 shutdown_connections 2024-04-13T02:45:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.343+0000 7fe7031e9640 1 -- 172.21.15.114:0/3559886944 wait complete. 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.344+0000 7fe7031e9640 1 Processor -- start 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.344+0000 7fe7031e9640 1 -- start start 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe7031e9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe7031e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc09b230 0x7fe6fc15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe7031e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0ce650 0x7fe6fc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe7031e9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc09bd90 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe7031e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc06ce50 con 0x7fe6fc0ce650 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe7031e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc0cea30 con 0x7fe6fc09b230 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc15ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34326/0 (socket says 172.21.15.114:34326) 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 -- 172.21.15.114:0/4267809500 learned_addr learned my addr 172.21.15.114:0/4267809500 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 -- 172.21.15.114:0/4267809500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc09b230 msgr2=0x7fe6fc15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc09b230 0x7fe6fc15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 -- 172.21.15.114:0/4267809500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0ce650 msgr2=0x7fe6fc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0ce650 0x7fe6fc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 -- 172.21.15.114:0/4267809500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc0b7ee0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.345+0000 7fe700f85640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc15ce10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c420 tx=0x7fe6ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.346+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0074e0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.346+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0047e0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.346+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc15f5b0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.346+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec004c10 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.346+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc15d350 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.347+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc068c80 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.347+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6ec011070 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.347+0000 7fe6f97fa640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe6e806c8f0 0x7fe6e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.347+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe6ec08b760 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.348+0000 7fe6fbfff640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe6e806c8f0 0x7fe6e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.348+0000 7fe6fbfff640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe6e806c8f0 0x7fe6e806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f60 tx=0x7fe6f00079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.352+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6ec059ba0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.525+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe6fc0750b0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.526+0000 7fe6f97fa640 1 -- 172.21.15.114:0/4267809500 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe6ec0594a0 con 0x7fe6fc06e2f0 2024-04-13T02:45:10.526 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:10.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.527+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe6e806c8f0 msgr2=0x7fe6e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.527+0000 7fe7031e9640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe6e806c8f0 0x7fe6e806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f60 tx=0x7fe6f00079b0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.527+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 msgr2=0x7fe6fc15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.527+0000 7fe7031e9640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc15ce10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c420 tx=0x7fe6ec00c8e0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 shutdown_connections 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0ce650 0x7fe6fc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe6e806c8f0 0x7fe6e806edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc09b230 0x7fe6fc15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 --2- 172.21.15.114:0/4267809500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6fc06e2f0 0x7fe6fc15ce10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 >> 172.21.15.114:0/4267809500 conn(0x7fe6fc0d2720 msgr2=0x7fe6fc0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 shutdown_connections 2024-04-13T02:45:10.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.528+0000 7fe7031e9640 1 -- 172.21.15.114:0/4267809500 wait complete. 2024-04-13T02:45:10.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:10.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.642+0000 7f13ea080640 1 Processor -- start 2024-04-13T02:45:10.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.642+0000 7f13ea080640 1 -- start start 2024-04-13T02:45:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13ea080640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13e415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13ea080640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e415d520 con 0x7f13e415a440 2024-04-13T02:45:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13ea080640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e415d800 con 0x7f13e4072150 2024-04-13T02:45:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13ea080640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f13e406e280 con 0x7f13e406fc80 2024-04-13T02:45:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e37fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f13e415a440 0x7f13e40cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48642/0 (socket says 172.21.15.114:48642) 2024-04-13T02:45:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e37fe640 1 -- 172.21.15.114:0/987469758 learned_addr learned my addr 172.21.15.114:0/987469758 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741832032 0 0) 0x7f13e415d520 con 0x7f13e415a440 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13e415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003520 con 0x7f13e415a440 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 992514740 0 0) 0x7f13cc003520 con 0x7f13e415a440 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 msgr2=0x7f13e415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13e415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 >> v1:172.21.15.130:6789/0 conn(0x7f13e4072150 legacy=0x7f13e406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e415dae0 con 0x7f13e415a440 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f13d8001690 con 0x7f13e415a440 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 >> v1:172.21.15.114:6789/0 conn(0x7f13e415a440 legacy=0x7f13e40cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13cc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13cc004d40 0x7f13cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13e406e280 con 0x7f13cc003f20 2024-04-13T02:45:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc00ba70 con 0x7f13cc004d40 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc00bc70 con 0x7f13e406fc80 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e3fff640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13cc004d40 0x7f13cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.643+0000 7f13e37fe640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13cc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e2ffd640 1 -- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 msgr2=0x7f13cc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13cc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e2ffd640 1 -- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13cc004d40 msgr2=0x7f13cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13cc004d40 0x7f13cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e2ffd640 1 -- 172.21.15.114:0/987469758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc003520 con 0x7f13cc003f20 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e3fff640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13cc004d40 0x7f13cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e37fe640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e406fc80 0x7f13cc0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13cc004800 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace4198db30589ef server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4039070 con 0x7f13cc003f20 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d402c6b0 con 0x7f13cc003f20 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.644+0000 7f13e27fc640 1 -- 172.21.15.114:0/987469758 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4009690 con 0x7f13cc003f20 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13ea080640 1 -- 172.21.15.114:0/987469758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 msgr2=0x7f13cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13ea080640 1 --2- 172.21.15.114:0/987469758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13cc004800 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13cc005830 comp rx=0 tx=0).stop 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13e3fff640 1 -- 172.21.15.114:0/987469758 reap_dead start 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13ea080640 1 -- 172.21.15.114:0/987469758 shutdown_connections 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13ea080640 1 -- 172.21.15.114:0/987469758 >> 172.21.15.114:0/987469758 conn(0x7f13e40b2460 msgr2=0x7f13e40b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13ea080640 1 -- 172.21.15.114:0/987469758 shutdown_connections 2024-04-13T02:45:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.645+0000 7f13ea080640 1 -- 172.21.15.114:0/987469758 wait complete. 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.646+0000 7f13ea080640 1 Processor -- start 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.646+0000 7f13ea080640 1 -- start start 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13ea080640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13e41f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13ea080640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e41f7ce0 0x7f13e415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13ea080640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13e415e510 0x7f13e41ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13ea080640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13e415ddc0 con 0x7f13cc003f20 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13ea080640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13e415a820 con 0x7f13e415e510 2024-04-13T02:45:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13ea080640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f13e406f510 con 0x7f13e41f7ce0 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13e41f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13e41f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34350/0 (socket says 172.21.15.114:34350) 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 -- 172.21.15.114:0/156695404 learned_addr learned my addr 172.21.15.114:0/156695404 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 -- 172.21.15.114:0/156695404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e41f7ce0 msgr2=0x7f13e415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e41f7ce0 0x7f13e415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 -- 172.21.15.114:0/156695404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13e415e510 msgr2=0x7f13e41ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13e415e510 0x7f13e41ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.647+0000 7f13e37fe640 1 -- 172.21.15.114:0/156695404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41f8160 con 0x7f13cc003f20 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.648+0000 7f13e37fe640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13e41f51e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13d800e820 tx=0x7f13d800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.648+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d800c7f0 con 0x7f13cc003f20 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.648+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8018070 con 0x7f13cc003f20 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.648+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41f8430 con 0x7f13cc003f20 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.648+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d800cb90 con 0x7f13cc003f20 2024-04-13T02:45:10.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.648+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41f89f0 con 0x7f13cc003f20 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.649+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e415e930 con 0x7f13cc003f20 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.649+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13d801d460 con 0x7f13cc003f20 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.650+0000 7f13cbfff640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f13d006c920 0x7f13d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.650+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f13d006c920 0x7f13d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.650+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f13d808bbb0 con 0x7f13cc003f20 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.650+0000 7f13e2ffd640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f13d006c920 0x7f13d006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.654+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13d805a0a0 con 0x7f13cc003f20 2024-04-13T02:45:10.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.828+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f13e4068c80 con 0x7f13cc003f20 2024-04-13T02:45:10.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.829+0000 7f13cbfff640 1 -- 172.21.15.114:0/156695404 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f13d80599a0 con 0x7f13cc003f20 2024-04-13T02:45:10.830 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f13d006c920 msgr2=0x7f13d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f13d006c920 0x7f13d006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13d402e000 comp rx=0 tx=0).stop 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 msgr2=0x7f13e41f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13e41f51e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13d800e820 tx=0x7f13d800ece0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 shutdown_connections 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13e415e510 0x7f13e41ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f13d006c920 0x7f13d006ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13e41f7ce0 0x7f13e415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 --2- 172.21.15.114:0/156695404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13cc003f20 0x7f13e41f51e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 >> 172.21.15.114:0/156695404 conn(0x7f13e40b2460 msgr2=0x7f13e40b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 shutdown_connections 2024-04-13T02:45:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.831+0000 7f13ea080640 1 -- 172.21.15.114:0/156695404 wait complete. 2024-04-13T02:45:10.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T02:45:10.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.943+0000 7fa884f1e640 1 Processor -- start 2024-04-13T02:45:10.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.943+0000 7fa884f1e640 1 -- start start 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa884f1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa884f1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa88015c130 0x7fa88006f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa884f1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8800cfd50 con 0x7fa8800afff0 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa884f1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa8800b3f30 con 0x7fa88015c130 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa884f1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa8800b4210 con 0x7fa8800cf690 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa877fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa87ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa88015c130 0x7fa88006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa87e59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa8800afff0 0x7fa880144e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56338/0 (socket says 172.21.15.114:56338) 2024-04-13T02:45:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa87e59c640 1 -- 172.21.15.114:0/2522453363 learned_addr learned my addr 172.21.15.114:0/2522453363 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa87dd9b640 1 -- 172.21.15.114:0/2522453363 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427196297 0 0) 0x7fa8800cfd50 con 0x7fa8800afff0 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa87dd9b640 1 -- 172.21.15.114:0/2522453363 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa86c005730 con 0x7fa8800afff0 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa877fff640 1 -- 172.21.15.114:0/2522453363 >> v2:172.21.15.130:3300/0 conn(0x7fa88015c130 msgr2=0x7fa88006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa877fff640 1 --2- 172.21.15.114:0/2522453363 >> v2:172.21.15.130:3300/0 conn(0x7fa88015c130 0x7fa88006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa877fff640 1 -- 172.21.15.114:0/2522453363 >> v1:172.21.15.130:6789/0 conn(0x7fa8800afff0 legacy=0x7fa880144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa877fff640 1 -- 172.21.15.114:0/2522453363 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8800d0030 con 0x7fa8800cf690 2024-04-13T02:45:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.944+0000 7fa87ed9d640 1 --2- 172.21.15.114:0/2522453363 >> v2:172.21.15.130:3300/0 conn(0x7fa88015c130 0x7fa88006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:10.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.945+0000 7fa877fff640 1 --2- 172.21.15.114:0/2522453363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88015bbf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8680097a0 tx=0x7fa86802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a3c858eee0e36f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.945+0000 7fa87dd9b640 1 -- 172.21.15.114:0/2522453363 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8680315a0 con 0x7fa8800cf690 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.945+0000 7fa87dd9b640 1 -- 172.21.15.114:0/2522453363 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868037070 con 0x7fa8800cf690 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.945+0000 7fa87dd9b640 1 -- 172.21.15.114:0/2522453363 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868031940 con 0x7fa8800cf690 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 -- 172.21.15.114:0/2522453363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 msgr2=0x7fa88015bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 --2- 172.21.15.114:0/2522453363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88015bbf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa8680097a0 tx=0x7fa86802b840 comp rx=0 tx=0).stop 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 -- 172.21.15.114:0/2522453363 shutdown_connections 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 --2- 172.21.15.114:0/2522453363 >> v2:172.21.15.130:3300/0 conn(0x7fa88015c130 0x7fa88006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 --2- 172.21.15.114:0/2522453363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88015bbf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 -- 172.21.15.114:0/2522453363 >> 172.21.15.114:0/2522453363 conn(0x7fa8800b2460 msgr2=0x7fa8800b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 -- 172.21.15.114:0/2522453363 shutdown_connections 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.946+0000 7fa884f1e640 1 -- 172.21.15.114:0/2522453363 wait complete. 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.947+0000 7fa884f1e640 1 Processor -- start 2024-04-13T02:45:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.947+0000 7fa884f1e640 1 -- start start 2024-04-13T02:45:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa884f1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 0x7fa8801419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa884f1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa884f1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa88015c130 0x7fa8801428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa884f1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa88006f750 con 0x7fa8800afff0 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa884f1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8800cfaf0 con 0x7fa88015c130 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa884f1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa88006f8d0 con 0x7fa8800cf690 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 0x7fa8801419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 0x7fa8801419b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34354/0 (socket says 172.21.15.114:34354) 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 -- 172.21.15.114:0/1203341319 learned_addr learned my addr 172.21.15.114:0/1203341319 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87ed9d640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa88015c130 0x7fa8801428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa877fff640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 -- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 msgr2=0x7fa88006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88006ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 -- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa88015c130 msgr2=0x7fa8801428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa88015c130 0x7fa8801428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.948+0000 7fa87e59c640 1 -- 172.21.15.114:0/1203341319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8800ac9f0 con 0x7fa8800afff0 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.949+0000 7fa87e59c640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 0x7fa8801419b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c430 tx=0x7fa87000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.949+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870017070 con 0x7fa8800afff0 2024-04-13T02:45:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.949+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa870005ce0 con 0x7fa8800afff0 2024-04-13T02:45:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.949+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8800accd0 con 0x7fa8800afff0 2024-04-13T02:45:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.949+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700072f0 con 0x7fa8800afff0 2024-04-13T02:45:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.949+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8800ad290 con 0x7fa8800afff0 2024-04-13T02:45:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.950+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa880068c80 con 0x7fa8800afff0 2024-04-13T02:45:10.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.950+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa87001a070 con 0x7fa8800afff0 2024-04-13T02:45:10.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.951+0000 7fa876ffd640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa86006c8f0 0x7fa86006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:10.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.951+0000 7fa877fff640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa86006c8f0 0x7fa86006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:10.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.951+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa87008afd0 con 0x7fa8800afff0 2024-04-13T02:45:10.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.951+0000 7fa877fff640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa86006c8f0 0x7fa86006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa868036000 tx=0x7fa86803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:10.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:10.955+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa870058ca0 con 0x7fa8800afff0 2024-04-13T02:45:11.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.144+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa8800ccd10 con 0x7fa8800afff0 2024-04-13T02:45:11.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.145+0000 7fa876ffd640 1 -- 172.21.15.114:0/1203341319 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fa87005cfa0 con 0x7fa8800afff0 2024-04-13T02:45:11.146 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa86006c8f0 msgr2=0x7fa86006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa86006c8f0 0x7fa86006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa868036000 tx=0x7fa86803d040 comp rx=0 tx=0).stop 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 msgr2=0x7fa8801419b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 0x7fa8801419b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c430 tx=0x7fa87000c830 comp rx=0 tx=0).stop 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 shutdown_connections 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa88015c130 0x7fa8801428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa86006c8f0 0x7fa86006edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8800cf690 0x7fa88006ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 --2- 172.21.15.114:0/1203341319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8800afff0 0x7fa8801419b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 >> 172.21.15.114:0/1203341319 conn(0x7fa8800b2460 msgr2=0x7fa8800b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:11.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 shutdown_connections 2024-04-13T02:45:11.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.147+0000 7fa884f1e640 1 -- 172.21.15.114:0/1203341319 wait complete. 2024-04-13T02:45:11.158 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-13T02:45:11.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:11.158 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-13T02:45:11.192 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:45:11.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:11.192 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-13T02:45:11.335 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:11.335 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:11.351 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:11.351 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:11.407 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:11.407 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:11.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:11.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.602+0000 7ff2ebd7b640 1 Processor -- start 2024-04-13T02:45:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.602+0000 7ff2ebd7b640 1 -- start start 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ebd7b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2e40cefc0 0x7ff2e40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ebd7b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ebd7b640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e40b4be0 con 0x7ff2e41461f0 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ebd7b640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e40a9640 con 0x7ff2e40cefc0 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ebd7b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e40b4620 con 0x7ff2e40b3e10 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9316640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2e40cefc0 0x7ff2e40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ea318640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9b17640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff2e41461f0 0x7ff2e40ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56344/0 (socket says 172.21.15.114:56344) 2024-04-13T02:45:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9316640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2e40cefc0 0x7ff2e40b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:39832/0 (socket says 172.21.15.114:39832) 2024-04-13T02:45:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9b17640 1 -- 172.21.15.114:0/3902861014 learned_addr learned my addr 172.21.15.114:0/3902861014 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9316640 1 -- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 msgr2=0x7ff2e415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9316640 1 --2- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9316640 1 -- 172.21.15.114:0/3902861014 >> v1:172.21.15.130:6789/0 conn(0x7ff2e41461f0 legacy=0x7ff2e40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2e9316640 1 -- 172.21.15.114:0/3902861014 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e40b4900 con 0x7ff2e40cefc0 2024-04-13T02:45:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.603+0000 7ff2ea318640 1 --2- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.604+0000 7ff2e9316640 1 --2- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40b38d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40097a0 tx=0x7ff2d402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3043b5ae198b431a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.604+0000 7ff2e8b15640 1 -- 172.21.15.114:0/3902861014 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4035020 con 0x7ff2e40cefc0 2024-04-13T02:45:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.604+0000 7ff2e8b15640 1 -- 172.21.15.114:0/3902861014 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4031830 con 0x7ff2e40cefc0 2024-04-13T02:45:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.604+0000 7ff2e8b15640 1 -- 172.21.15.114:0/3902861014 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4031c00 con 0x7ff2e40cefc0 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 msgr2=0x7ff2e40b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40b38d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40097a0 tx=0x7ff2d402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3902861014 shutdown_connections 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3902861014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40b38d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3902861014 >> 172.21.15.114:0/3902861014 conn(0x7ff2e40b27b0 msgr2=0x7ff2e40b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3902861014 shutdown_connections 2024-04-13T02:45:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.605+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3902861014 wait complete. 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.606+0000 7ff2ebd7b640 1 Processor -- start 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.606+0000 7ff2ebd7b640 1 -- start start 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ebd7b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e40af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ebd7b640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ebd7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 0x7ff2e40ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ebd7b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e41465d0 con 0x7ff2e41461f0 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ebd7b640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e415d290 con 0x7ff2e40cefc0 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ebd7b640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e40b4280 con 0x7ff2e40b3e10 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 0x7ff2e40ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 0x7ff2e40ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34366/0 (socket says 172.21.15.114:34366) 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 -- 172.21.15.114:0/3600614605 learned_addr learned my addr 172.21.15.114:0/3600614605 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2e9b17640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e40af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2e9316640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 -- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 msgr2=0x7ff2e40af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e40af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 -- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 msgr2=0x7ff2e40aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 -- 172.21.15.114:0/3600614605 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e40aaf30 con 0x7ff2e41461f0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2e9b17640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e40af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2e9316640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.607+0000 7ff2ea318640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 0x7ff2e40ad230 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00efc0 tx=0x7ff2dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.608+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc018030 con 0x7ff2e41461f0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.608+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00cde0 con 0x7ff2e41461f0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.608+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e40afa30 con 0x7ff2e41461f0 2024-04-13T02:45:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.608+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc003bb0 con 0x7ff2e41461f0 2024-04-13T02:45:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.608+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e40ac110 con 0x7ff2e41461f0 2024-04-13T02:45:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.609+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e40cfa40 con 0x7ff2e41461f0 2024-04-13T02:45:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.609+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2dc005d10 con 0x7ff2e41461f0 2024-04-13T02:45:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.610+0000 7ff2da7fc640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2c806c8f0 0x7ff2c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.610+0000 7ff2e9b17640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2c806c8f0 0x7ff2c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.610+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2dc08c540 con 0x7ff2e41461f0 2024-04-13T02:45:11.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.610+0000 7ff2e9b17640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2c806c8f0 0x7ff2c806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0000f60 tx=0x7ff2e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.614+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2e40cfa40 con 0x7ff2e41461f0 2024-04-13T02:45:11.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.791+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2e4068c80 con 0x7ff2e41461f0 2024-04-13T02:45:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.792+0000 7ff2da7fc640 1 -- 172.21.15.114:0/3600614605 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7ff2dc022070 con 0x7ff2e41461f0 2024-04-13T02:45:11.793 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2c806c8f0 msgr2=0x7ff2c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2c806c8f0 0x7ff2c806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0000f60 tx=0x7ff2e0009040 comp rx=0 tx=0).stop 2024-04-13T02:45:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 msgr2=0x7ff2e40ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 0x7ff2e40ad230 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00efc0 tx=0x7ff2dc009f90 comp rx=0 tx=0).stop 2024-04-13T02:45:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 shutdown_connections 2024-04-13T02:45:11.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2e41461f0 0x7ff2e40ad230 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2e40cefc0 0x7ff2e40aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2c806c8f0 0x7ff2c806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 --2- 172.21.15.114:0/3600614605 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2e40b3e10 0x7ff2e40af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 >> 172.21.15.114:0/3600614605 conn(0x7ff2e40b27b0 msgr2=0x7ff2e4142d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 shutdown_connections 2024-04-13T02:45:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.794+0000 7ff2ebd7b640 1 -- 172.21.15.114:0/3600614605 wait complete. 2024-04-13T02:45:11.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:11.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.908+0000 7fbd9f3aa640 1 Processor -- start 2024-04-13T02:45:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9f3aa640 1 -- start start 2024-04-13T02:45:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9f3aa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd980b54b0 0x7fbd980b5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9f3aa640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbd9806f260 0x7fbd9806f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9f3aa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9806fbb0 con 0x7fbd98145170 2024-04-13T02:45:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9f3aa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbd98145550 con 0x7fbd980b54b0 2024-04-13T02:45:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9f3aa640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fbd980b4410 con 0x7fbd9806f260 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9c945640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd980b54b0 0x7fbd980b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.909+0000 7fbd9c945640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd980b54b0 0x7fbd980b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34382/0 (socket says 172.21.15.114:34382) 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9c945640 1 -- 172.21.15.114:0/538934992 learned_addr learned my addr 172.21.15.114:0/538934992 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9d947640 1 --2- 172.21.15.114:0/538934992 >> v2:172.21.15.130:3300/0 conn(0x7fbd9806f260 0x7fbd9806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9c945640 1 -- 172.21.15.114:0/538934992 >> v2:172.21.15.130:3300/0 conn(0x7fbd9806f260 msgr2=0x7fbd9806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9c945640 1 --2- 172.21.15.114:0/538934992 >> v2:172.21.15.130:3300/0 conn(0x7fbd9806f260 0x7fbd9806f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9c945640 1 -- 172.21.15.114:0/538934992 >> v1:172.21.15.130:6789/0 conn(0x7fbd98145170 legacy=0x7fbd980cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9c945640 1 -- 172.21.15.114:0/538934992 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd980b46f0 con 0x7fbd980b54b0 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9d947640 1 --2- 172.21.15.114:0/538934992 >> v2:172.21.15.130:3300/0 conn(0x7fbd9806f260 0x7fbd9806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.910+0000 7fbd9c945640 1 --2- 172.21.15.114:0/538934992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd980b54b0 0x7fbd980b5940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbd980b3dd0 tx=0x7fbd8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14731754ce36dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd8ffff640 1 -- 172.21.15.114:0/538934992 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88035020 con 0x7fbd980b54b0 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd8ffff640 1 -- 172.21.15.114:0/538934992 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88031870 con 0x7fbd980b54b0 2024-04-13T02:45:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd8ffff640 1 -- 172.21.15.114:0/538934992 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88031c40 con 0x7fbd980b54b0 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/538934992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd980b54b0 msgr2=0x7fbd980b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/538934992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd980b54b0 0x7fbd980b5940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbd980b3dd0 tx=0x7fbd8802b910 comp rx=0 tx=0).stop 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/538934992 shutdown_connections 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/538934992 >> v2:172.21.15.130:3300/0 conn(0x7fbd9806f260 0x7fbd9806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/538934992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd980b54b0 0x7fbd980b5940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/538934992 >> 172.21.15.114:0/538934992 conn(0x7fbd980b2460 msgr2=0x7fbd980b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/538934992 shutdown_connections 2024-04-13T02:45:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.911+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/538934992 wait complete. 2024-04-13T02:45:11.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.912+0000 7fbd9f3aa640 1 Processor -- start 2024-04-13T02:45:11.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 -- start start 2024-04-13T02:45:11.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 0x7fbd981f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd980b54b0 0x7fbd9815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd98145170 0x7fbd980b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd980b4f90 con 0x7fbd9806f260 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd980b4cb0 con 0x7fbd98145170 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9f3aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbd980ce240 con 0x7fbd980b54b0 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9d146640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 0x7fbd981f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9d146640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 0x7fbd981f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34390/0 (socket says 172.21.15.114:34390) 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.913+0000 7fbd9d146640 1 -- 172.21.15.114:0/843426336 learned_addr learned my addr 172.21.15.114:0/843426336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d947640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd98145170 0x7fbd980b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9c945640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd980b54b0 0x7fbd9815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d146640 1 -- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd980b54b0 msgr2=0x7fbd9815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d146640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd980b54b0 0x7fbd9815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d146640 1 -- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd98145170 msgr2=0x7fbd980b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d146640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd98145170 0x7fbd980b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d146640 1 -- 172.21.15.114:0/843426336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd980c5800 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9d146640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 0x7fbd981f4f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c430 tx=0x7fbd9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94011790 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd94017070 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94011bb0 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd980c5ae0 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.914+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd980c60a0 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.915+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd98068c80 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.916+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd9401c460 con 0x7fbd9806f260 2024-04-13T02:45:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.916+0000 7fbd8dffb640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd7c06c920 0x7fbd7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.916+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbd9408b940 con 0x7fbd9806f260 2024-04-13T02:45:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.916+0000 7fbd9c945640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd7c06c920 0x7fbd7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.916+0000 7fbd9c945640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd7c06c920 0x7fbd7c06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd88036000 tx=0x7fbd8803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:11.920+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd94059e00 con 0x7fbd9806f260 2024-04-13T02:45:12.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.094+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbd9806f990 con 0x7fbd9806f260 2024-04-13T02:45:12.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.094+0000 7fbd8dffb640 1 -- 172.21.15.114:0/843426336 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbd94059700 con 0x7fbd9806f260 2024-04-13T02:45:12.095 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd7c06c920 msgr2=0x7fbd7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd7c06c920 0x7fbd7c06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd88036000 tx=0x7fbd8803c040 comp rx=0 tx=0).stop 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 msgr2=0x7fbd981f4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 0x7fbd981f4f80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c430 tx=0x7fbd9400c8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 shutdown_connections 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd98145170 0x7fbd980b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd7c06c920 0x7fbd7c06ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd980b54b0 0x7fbd9815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 --2- 172.21.15.114:0/843426336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9806f260 0x7fbd981f4f80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 >> 172.21.15.114:0/843426336 conn(0x7fbd980b2460 msgr2=0x7fbd9806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 shutdown_connections 2024-04-13T02:45:12.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.097+0000 7fbd9f3aa640 1 -- 172.21.15.114:0/843426336 wait complete. 2024-04-13T02:45:12.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.210+0000 7f4602e29640 1 Processor -- start 2024-04-13T02:45:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4602e29640 1 -- start start 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4602e29640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45fc1622c0 0x7f45fc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4602e29640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f45fc0d2370 0x7f45fc06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4602e29640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc06deb0 con 0x7f45fc06e720 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4602e29640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc06dc60 con 0x7f45fc1622c0 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4602e29640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc06e120 con 0x7f45fc0d2370 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4600bc5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45fc1622c0 0x7f45fc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4600bc5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45fc1622c0 0x7f45fc06ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34400/0 (socket says 172.21.15.114:34400) 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.211+0000 7f4600bc5640 1 -- 172.21.15.114:0/3453082244 learned_addr learned my addr 172.21.15.114:0/3453082244 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f45fbfff640 1 --2- 172.21.15.114:0/3453082244 >> v2:172.21.15.130:3300/0 conn(0x7f45fc0d2370 0x7f45fc06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f4600bc5640 1 -- 172.21.15.114:0/3453082244 >> v2:172.21.15.130:3300/0 conn(0x7f45fc0d2370 msgr2=0x7f45fc06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f4600bc5640 1 --2- 172.21.15.114:0/3453082244 >> v2:172.21.15.130:3300/0 conn(0x7f45fc0d2370 0x7f45fc06cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f4600bc5640 1 -- 172.21.15.114:0/3453082244 >> v1:172.21.15.130:6789/0 conn(0x7f45fc06e720 legacy=0x7f45fc0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f4600bc5640 1 -- 172.21.15.114:0/3453082244 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc06d6a0 con 0x7f45fc1622c0 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f45fbfff640 1 --2- 172.21.15.114:0/3453082244 >> v2:172.21.15.130:3300/0 conn(0x7f45fc0d2370 0x7f45fc06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.212+0000 7f4600bc5640 1 --2- 172.21.15.114:0/3453082244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc1622c0 0x7f45fc06ca40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06fc10 tx=0x7f45f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a81950cf8ee21b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f45fb7fe640 1 -- 172.21.15.114:0/3453082244 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0034070 con 0x7f45fc1622c0 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f45fb7fe640 1 -- 172.21.15.114:0/3453082244 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0030860 con 0x7f45fc1622c0 2024-04-13T02:45:12.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f45fb7fe640 1 -- 172.21.15.114:0/3453082244 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0030c30 con 0x7f45fc1622c0 2024-04-13T02:45:12.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 -- 172.21.15.114:0/3453082244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc1622c0 msgr2=0x7f45fc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 --2- 172.21.15.114:0/3453082244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc1622c0 0x7f45fc06ca40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f45fc06fc10 tx=0x7f45f002b9a0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 -- 172.21.15.114:0/3453082244 shutdown_connections 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 --2- 172.21.15.114:0/3453082244 >> v2:172.21.15.130:3300/0 conn(0x7f45fc0d2370 0x7f45fc06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 --2- 172.21.15.114:0/3453082244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc1622c0 0x7f45fc06ca40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 -- 172.21.15.114:0/3453082244 >> 172.21.15.114:0/3453082244 conn(0x7f45fc0d2750 msgr2=0x7f45fc0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 -- 172.21.15.114:0/3453082244 shutdown_connections 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.213+0000 7f4602e29640 1 -- 172.21.15.114:0/3453082244 wait complete. 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.214+0000 7f4602e29640 1 Processor -- start 2024-04-13T02:45:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.214+0000 7f4602e29640 1 -- start start 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4602e29640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 0x7f45fc154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4602e29640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc0d2370 0x7f45fc0b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4602e29640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45fc1622c0 0x7f45fc0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4602e29640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc09bd20 con 0x7f45fc06e720 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4602e29640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc09bba0 con 0x7f45fc0d2370 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4602e29640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc0707f0 con 0x7f45fc1622c0 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4600bc5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 0x7f45fc154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4600bc5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 0x7f45fc154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34404/0 (socket says 172.21.15.114:34404) 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.215+0000 7f4600bc5640 1 -- 172.21.15.114:0/3935165932 learned_addr learned my addr 172.21.15.114:0/3935165932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4600bc5640 1 -- 172.21.15.114:0/3935165932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45fc1622c0 msgr2=0x7f45fc0b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4600bc5640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45fc1622c0 0x7f45fc0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4600bc5640 1 -- 172.21.15.114:0/3935165932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc0d2370 msgr2=0x7f45fc0b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4600bc5640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc0d2370 0x7f45fc0b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4600bc5640 1 -- 172.21.15.114:0/3935165932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc0c7790 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4600bc5640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 0x7f45fc154ed0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f45f0000c00 tx=0x7f45f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0034040 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0039d90 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc0c7a70 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0043610 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.216+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc0c8030 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.217+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc068c80 con 0x7f45fc06e720 2024-04-13T02:45:12.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.217+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45f0037070 con 0x7f45fc06e720 2024-04-13T02:45:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.218+0000 7f45f97fa640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.218+0000 7f45fbfff640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.218+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45f00adc30 con 0x7f45fc06e720 2024-04-13T02:45:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.218+0000 7f45fbfff640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f45e006c8f0 0x7f45e006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45e8006e80 tx=0x7f45e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.223+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45f003e070 con 0x7f45fc06e720 2024-04-13T02:45:12.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.400+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f45fc0d1490 con 0x7f45fc06e720 2024-04-13T02:45:12.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.400+0000 7f45f97fa640 1 -- 172.21.15.114:0/3935165932 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f45f007c0f0 con 0x7f45fc06e720 2024-04-13T02:45:12.401 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f45e006c8f0 msgr2=0x7f45e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f45e006c8f0 0x7f45e006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45e8006e80 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 msgr2=0x7f45fc154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 0x7f45fc154ed0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f45f0000c00 tx=0x7f45f00046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 shutdown_connections 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f45fc1622c0 0x7f45fc0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f45fc0d2370 0x7f45fc0b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 --2- 172.21.15.114:0/3935165932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45fc06e720 0x7f45fc154ed0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 >> 172.21.15.114:0/3935165932 conn(0x7f45fc0d2750 msgr2=0x7f45fc0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 shutdown_connections 2024-04-13T02:45:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.402+0000 7f4602e29640 1 -- 172.21.15.114:0/3935165932 wait complete. 2024-04-13T02:45:12.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.516+0000 7fd34c605640 1 Processor -- start 2024-04-13T02:45:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.516+0000 7fd34c605640 1 -- start start 2024-04-13T02:45:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34c605640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440b6c30 0x7fd3440b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34c605640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd3440701a0 0x7fd344070580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34c605640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd344070f00 con 0x7fd3440d15f0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34c605640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fd344071440 con 0x7fd3440701a0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34c605640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440711a0 con 0x7fd3440b6c30 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd349ba0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd3440701a0 0x7fd344070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34aba2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd3440d15f0 0x7fd3440d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48658/0 (socket says 172.21.15.114:48658) 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.517+0000 7fd34aba2640 1 -- 172.21.15.114:0/393303254 learned_addr learned my addr 172.21.15.114:0/393303254 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd34a3a1640 1 --2- 172.21.15.114:0/393303254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440b6c30 0x7fd3440b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd349ba0640 1 -- 172.21.15.114:0/393303254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440b6c30 msgr2=0x7fd3440b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd349ba0640 1 --2- 172.21.15.114:0/393303254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440b6c30 0x7fd3440b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd349ba0640 1 -- 172.21.15.114:0/393303254 >> v1:172.21.15.114:6789/0 conn(0x7fd3440d15f0 legacy=0x7fd3440d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd349ba0640 1 -- 172.21.15.114:0/393303254 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440b7550 con 0x7fd3440701a0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd34939f640 1 -- 172.21.15.114:0/393303254 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4175088559 0 0) 0x7fd344070f00 con 0x7fd3440d15f0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.518+0000 7fd349ba0640 1 --2- 172.21.15.114:0/393303254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440701a0 0x7fd344070580 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd33802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5262abe64e7dff3c server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34939f640 1 -- 172.21.15.114:0/393303254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338035020 con 0x7fd3440701a0 2024-04-13T02:45:12.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34939f640 1 -- 172.21.15.114:0/393303254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd338031830 con 0x7fd3440701a0 2024-04-13T02:45:12.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34939f640 1 -- 172.21.15.114:0/393303254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338031c00 con 0x7fd3440701a0 2024-04-13T02:45:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 -- 172.21.15.114:0/393303254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440701a0 msgr2=0x7fd344070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 --2- 172.21.15.114:0/393303254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440701a0 0x7fd344070580 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd33802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 -- 172.21.15.114:0/393303254 shutdown_connections 2024-04-13T02:45:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 --2- 172.21.15.114:0/393303254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440701a0 0x7fd344070580 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 --2- 172.21.15.114:0/393303254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440b6c30 0x7fd3440b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 -- 172.21.15.114:0/393303254 >> 172.21.15.114:0/393303254 conn(0x7fd34409aa40 msgr2=0x7fd34409ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 -- 172.21.15.114:0/393303254 shutdown_connections 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.519+0000 7fd34c605640 1 -- 172.21.15.114:0/393303254 wait complete. 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.520+0000 7fd34c605640 1 Processor -- start 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.520+0000 7fd34c605640 1 -- start start 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd34c605640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440701a0 0x7fd34413d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd34c605640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 0x7fd34409dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd34c605640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3440d15f0 0x7fd34415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd34c605640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd3441453d0 con 0x7fd3440b6c30 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd34c605640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440af0a0 con 0x7fd3440d15f0 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd34c605640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd344145550 con 0x7fd3440701a0 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 0x7fd34409dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 0x7fd34409dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34408/0 (socket says 172.21.15.114:34408) 2024-04-13T02:45:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 -- 172.21.15.114:0/340541723 learned_addr learned my addr 172.21.15.114:0/340541723 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 -- 172.21.15.114:0/340541723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440701a0 msgr2=0x7fd34413d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440701a0 0x7fd34413d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 -- 172.21.15.114:0/340541723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3440d15f0 msgr2=0x7fd34415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3440d15f0 0x7fd34415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.521+0000 7fd349ba0640 1 -- 172.21.15.114:0/340541723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34409e9d0 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.522+0000 7fd349ba0640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 0x7fd34409dff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd338009890 tx=0x7fd3380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.522+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338041070 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.522+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33803b920 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.522+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338035040 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.522+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34409ecb0 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.522+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34409f270 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.523+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3440b6410 con 0x7fd3440b6c30 2024-04-13T02:45:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.523+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd33804c060 con 0x7fd3440b6c30 2024-04-13T02:45:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.523+0000 7fd342ffd640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd33006c8f0 0x7fd33006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.524+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd3380ad4d0 con 0x7fd3440b6c30 2024-04-13T02:45:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.524+0000 7fd34a3a1640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd33006c8f0 0x7fd33006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.524+0000 7fd34a3a1640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd33006c8f0 0x7fd33006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0070b0 tx=0x7fd33c007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.528+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd3440b6410 con 0x7fd3440b6c30 2024-04-13T02:45:12.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.702+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd3440b3160 con 0x7fd3440b6c30 2024-04-13T02:45:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.702+0000 7fd342ffd640 1 -- 172.21.15.114:0/340541723 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd33807b910 con 0x7fd3440b6c30 2024-04-13T02:45:12.703 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd33006c8f0 msgr2=0x7fd33006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd33006c8f0 0x7fd33006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0070b0 tx=0x7fd33c007040 comp rx=0 tx=0).stop 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 msgr2=0x7fd34409dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 0x7fd34409dff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd338009890 tx=0x7fd3380046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 shutdown_connections 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3440d15f0 0x7fd34415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3440b6c30 0x7fd34409dff0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd33006c8f0 0x7fd33006edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 --2- 172.21.15.114:0/340541723 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3440701a0 0x7fd34413d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 >> 172.21.15.114:0/340541723 conn(0x7fd34409aa40 msgr2=0x7fd3441439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 shutdown_connections 2024-04-13T02:45:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.704+0000 7fd34c605640 1 -- 172.21.15.114:0/340541723 wait complete. 2024-04-13T02:45:12.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T02:45:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.815+0000 7f76f1636640 1 Processor -- start 2024-04-13T02:45:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.815+0000 7f76f1636640 1 -- start start 2024-04-13T02:45:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76f1636640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec15ec40 0x7f76ec0d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76f1636640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f76ec0d2c30 0x7f76ec0ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76f1636640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec0ba8d0 con 0x7f76ec0d1300 2024-04-13T02:45:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76f1636640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f76ec0d3090 con 0x7f76ec0d2c30 2024-04-13T02:45:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76f1636640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec0d32c0 con 0x7f76ec15ec40 2024-04-13T02:45:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76eaffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec15ec40 0x7f76ec0d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76e3fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f76ec0d2c30 0x7f76ec0ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76eb7fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f76ec0d1300 0x7f76ec0b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56364/0 (socket says 172.21.15.114:56364) 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.816+0000 7f76eb7fe640 1 -- 172.21.15.114:0/387512315 learned_addr learned my addr 172.21.15.114:0/387512315 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.817+0000 7f76e3fff640 1 -- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec15ec40 msgr2=0x7f76ec0d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.817+0000 7f76e3fff640 1 --2- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec15ec40 0x7f76ec0d4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.817+0000 7f76e3fff640 1 -- 172.21.15.114:0/387512315 >> v1:172.21.15.130:6789/0 conn(0x7f76ec0d1300 legacy=0x7f76ec0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.817+0000 7f76e3fff640 1 -- 172.21.15.114:0/387512315 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec0d35a0 con 0x7f76ec0d2c30 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.817+0000 7f76ea7fc640 1 -- 172.21.15.114:0/387512315 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719103417 0 0) 0x7f76ec0ba8d0 con 0x7f76ec0d1300 2024-04-13T02:45:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.817+0000 7f76eaffd640 1 --2- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec15ec40 0x7f76ec0d4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76e3fff640 1 --2- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec0ba390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097a0 tx=0x7f76d402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35e4d9642f65ff22 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76ea7fc640 1 -- 172.21.15.114:0/387512315 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4035020 con 0x7f76ec0d2c30 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76ea7fc640 1 -- 172.21.15.114:0/387512315 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d4031830 con 0x7f76ec0d2c30 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76ea7fc640 1 -- 172.21.15.114:0/387512315 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4031c00 con 0x7f76ec0d2c30 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 -- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 msgr2=0x7f76ec0ba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 --2- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec0ba390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097a0 tx=0x7f76d402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 -- 172.21.15.114:0/387512315 shutdown_connections 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 --2- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec0ba390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 --2- 172.21.15.114:0/387512315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec15ec40 0x7f76ec0d4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 -- 172.21.15.114:0/387512315 >> 172.21.15.114:0/387512315 conn(0x7f76ec073690 msgr2=0x7f76ec06cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 -- 172.21.15.114:0/387512315 shutdown_connections 2024-04-13T02:45:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.818+0000 7f76f1636640 1 -- 172.21.15.114:0/387512315 wait complete. 2024-04-13T02:45:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.819+0000 7f76f1636640 1 Processor -- start 2024-04-13T02:45:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 -- start start 2024-04-13T02:45:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec0d1300 0x7f76ec15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 0x7f76ec15be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec0d3e40 con 0x7f76ec15ec40 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec0d3b60 con 0x7f76ec0d2c30 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76f1636640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec0d1790 con 0x7f76ec0d1300 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76eb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 0x7f76ec15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76eb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 0x7f76ec15be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34424/0 (socket says 172.21.15.114:34424) 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76eb7fe640 1 -- 172.21.15.114:0/93357178 learned_addr learned my addr 172.21.15.114:0/93357178 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76eaffd640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec0d1300 0x7f76ec15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.820+0000 7f76e3fff640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76eb7fe640 1 -- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec0d1300 msgr2=0x7f76ec15f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76eb7fe640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec0d1300 0x7f76ec15f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76eb7fe640 1 -- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 msgr2=0x7f76ec14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76eb7fe640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76eb7fe640 1 -- 172.21.15.114:0/93357178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec15fd00 con 0x7f76ec15ec40 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76eb7fe640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 0x7f76ec15be30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f76e400c7d0 tx=0x7f76e400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4018070 con 0x7f76ec15ec40 2024-04-13T02:45:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e400a640 con 0x7f76ec15ec40 2024-04-13T02:45:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e400aa70 con 0x7f76ec15ec40 2024-04-13T02:45:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec15ffe0 con 0x7f76ec15ec40 2024-04-13T02:45:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.821+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec15aeb0 con 0x7f76ec15ec40 2024-04-13T02:45:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.822+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec0b4e30 con 0x7f76ec15ec40 2024-04-13T02:45:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.822+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76e401b070 con 0x7f76ec15ec40 2024-04-13T02:45:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.823+0000 7f76e37fe640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f76cc06c920 0x7f76cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.823+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f76e408b130 con 0x7f76ec15ec40 2024-04-13T02:45:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.823+0000 7f76eaffd640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f76cc06c920 0x7f76cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.823+0000 7f76eaffd640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f76cc06c920 0x7f76cc06ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009560 tx=0x7f76dc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:12.827+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76ec0b4e30 con 0x7f76ec15ec40 2024-04-13T02:45:13.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.016+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76ec0692d0 con 0x7f76ec15ec40 2024-04-13T02:45:13.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.016+0000 7f76e37fe640 1 -- 172.21.15.114:0/93357178 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f76ec0692d0 con 0x7f76ec15ec40 2024-04-13T02:45:13.017 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-13T02:45:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f76cc06c920 msgr2=0x7f76cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f76cc06c920 0x7f76cc06ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009560 tx=0x7f76dc009190 comp rx=0 tx=0).stop 2024-04-13T02:45:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 msgr2=0x7f76ec15be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 0x7f76ec15be30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f76e400c7d0 tx=0x7f76e400cc90 comp rx=0 tx=0).stop 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 shutdown_connections 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76ec15ec40 0x7f76ec15be30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76ec0d2c30 0x7f76ec14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f76cc06c920 0x7f76cc06ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 --2- 172.21.15.114:0/93357178 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76ec0d1300 0x7f76ec15f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 >> 172.21.15.114:0/93357178 conn(0x7f76ec073690 msgr2=0x7f76ec0b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 shutdown_connections 2024-04-13T02:45:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.018+0000 7f76f1636640 1 -- 172.21.15.114:0/93357178 wait complete. 2024-04-13T02:45:13.030 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-13T02:45:13.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:13.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-13T02:45:13.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:45:13.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:13.058 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-13T02:45:13.113 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:13.114 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:13.132 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:13.200 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:13.218 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:45:13.218 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:13.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.376+0000 7f1edf6de640 1 Processor -- start 2024-04-13T02:45:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.376+0000 7f1edf6de640 1 -- start start 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edf6de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1ed815b6d0 0x7f1ed80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edf6de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed80b51f0 0x7f1ed815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edf6de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed806f940 con 0x7f1ed8070210 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edf6de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed806e8a0 con 0x7f1ed815b6d0 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edf6de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed806eb80 con 0x7f1ed80b51f0 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edd47a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1ed815b6d0 0x7f1ed80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edcc79640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1ed8070210 0x7f1ed80b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48668/0 (socket says 172.21.15.114:48668) 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edcc79640 1 -- 172.21.15.114:0/3125763070 learned_addr learned my addr 172.21.15.114:0/3125763070 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1ecffff640 1 -- 172.21.15.114:0/3125763070 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828831185 0 0) 0x7f1ed806f940 con 0x7f1ed8070210 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1eddc7b640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed80b51f0 0x7f1ed815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1ecffff640 1 -- 172.21.15.114:0/3125763070 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ec4003520 con 0x7f1ed8070210 2024-04-13T02:45:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edd47a640 1 -- 172.21.15.114:0/3125763070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed80b51f0 msgr2=0x7f1ed815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edd47a640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed80b51f0 0x7f1ed815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edd47a640 1 -- 172.21.15.114:0/3125763070 >> v1:172.21.15.114:6789/0 conn(0x7f1ed8070210 legacy=0x7f1ed80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1edd47a640 1 -- 172.21.15.114:0/3125763070 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed806ee60 con 0x7f1ed815b6d0 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.377+0000 7f1eddc7b640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed80b51f0 0x7f1ed815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.378+0000 7f1edd47a640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed815b6d0 0x7f1ed80cdd10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009d90 tx=0x7f1ed402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fd3c503112620b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.378+0000 7f1ecffff640 1 -- 172.21.15.114:0/3125763070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4039070 con 0x7f1ed815b6d0 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.378+0000 7f1ecffff640 1 -- 172.21.15.114:0/3125763070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed402cbc0 con 0x7f1ed815b6d0 2024-04-13T02:45:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.378+0000 7f1ecffff640 1 -- 172.21.15.114:0/3125763070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4034440 con 0x7f1ed815b6d0 2024-04-13T02:45:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 -- 172.21.15.114:0/3125763070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed815b6d0 msgr2=0x7f1ed80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed815b6d0 0x7f1ed80cdd10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009d90 tx=0x7f1ed402be10 comp rx=0 tx=0).stop 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 -- 172.21.15.114:0/3125763070 shutdown_connections 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed80b51f0 0x7f1ed815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3125763070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed815b6d0 0x7f1ed80cdd10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 -- 172.21.15.114:0/3125763070 >> 172.21.15.114:0/3125763070 conn(0x7f1ed80b27b0 msgr2=0x7f1ed80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 -- 172.21.15.114:0/3125763070 shutdown_connections 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.379+0000 7f1edf6de640 1 -- 172.21.15.114:0/3125763070 wait complete. 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.380+0000 7f1edf6de640 1 Processor -- start 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.380+0000 7f1edf6de640 1 -- start start 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edf6de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 0x7f1ed8149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edf6de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ed80b51f0 0x7f1ed81473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edf6de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed815b6d0 0x7f1ed8142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edf6de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80ce250 con 0x7f1ed8070210 2024-04-13T02:45:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edf6de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed806f420 con 0x7f1ed80b51f0 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edf6de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80ce3d0 con 0x7f1ed815b6d0 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 0x7f1ed8149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 0x7f1ed8149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34442/0 (socket says 172.21.15.114:34442) 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 -- 172.21.15.114:0/3415067904 learned_addr learned my addr 172.21.15.114:0/3415067904 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edcc79640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ed80b51f0 0x7f1ed81473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1eddc7b640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed815b6d0 0x7f1ed8142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 -- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed815b6d0 msgr2=0x7f1ed8142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed815b6d0 0x7f1ed8142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 -- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ed80b51f0 msgr2=0x7f1ed81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ed80b51f0 0x7f1ed81473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 -- 172.21.15.114:0/3415067904 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8148bd0 con 0x7f1ed8070210 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edcc79640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ed80b51f0 0x7f1ed81473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1edd47a640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 0x7f1ed8149ea0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009d90 tx=0x7f1ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.381+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4039050 con 0x7f1ed8070210 2024-04-13T02:45:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.382+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed4045070 con 0x7f1ed8070210 2024-04-13T02:45:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.382+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed403e850 con 0x7f1ed8070210 2024-04-13T02:45:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.382+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed8147b30 con 0x7f1ed8070210 2024-04-13T02:45:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.382+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81480f0 con 0x7f1ed8070210 2024-04-13T02:45:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.383+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8068c80 con 0x7f1ed8070210 2024-04-13T02:45:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.383+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ed403e9f0 con 0x7f1ed8070210 2024-04-13T02:45:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.383+0000 7f1ecdffb640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ebc06c8f0 0x7f1ebc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.384+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1ed40ae980 con 0x7f1ed8070210 2024-04-13T02:45:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.384+0000 7f1edcc79640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ebc06c8f0 0x7f1ebc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.384+0000 7f1edcc79640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ebc06c8f0 0x7f1ebc06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8007fd0 tx=0x7f1ec8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.388+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ed407cf60 con 0x7f1ed8070210 2024-04-13T02:45:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.564+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ed80d0560 con 0x7f1ed8070210 2024-04-13T02:45:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.565+0000 7f1ecdffb640 1 -- 172.21.15.114:0/3415067904 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f1ed407c860 con 0x7f1ed8070210 2024-04-13T02:45:13.566 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:13.566 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ebc06c8f0 msgr2=0x7f1ebc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ebc06c8f0 0x7f1ebc06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8007fd0 tx=0x7f1ec8009040 comp rx=0 tx=0).stop 2024-04-13T02:45:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 msgr2=0x7f1ed8149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 0x7f1ed8149ea0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009d90 tx=0x7f1ed4004a40 comp rx=0 tx=0).stop 2024-04-13T02:45:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 shutdown_connections 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ebc06c8f0 0x7f1ebc06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ed815b6d0 0x7f1ed8142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ed80b51f0 0x7f1ed81473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 --2- 172.21.15.114:0/3415067904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ed8070210 0x7f1ed8149ea0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 >> 172.21.15.114:0/3415067904 conn(0x7f1ed80b27b0 msgr2=0x7f1ed814fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 shutdown_connections 2024-04-13T02:45:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.567+0000 7f1edf6de640 1 -- 172.21.15.114:0/3415067904 wait complete. 2024-04-13T02:45:13.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:13.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.683+0000 7f3357ead640 1 Processor -- start 2024-04-13T02:45:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.683+0000 7f3357ead640 1 -- start start 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3357ead640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f335013dfe0 0x7f335015be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3357ead640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f335015f820 0x7f33500729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3357ead640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33500ccaf0 con 0x7f3350072f20 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3357ead640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f33500cdb90 con 0x7f335015f820 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3357ead640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f33500ccdd0 con 0x7f335013dfe0 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f335015f820 0x7f33500729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f335015f820 0x7f33500729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34458/0 (socket says 172.21.15.114:34458) 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 -- 172.21.15.114:0/372350498 learned_addr learned my addr 172.21.15.114:0/372350498 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355c49640 1 --2- 172.21.15.114:0/372350498 >> v2:172.21.15.130:3300/0 conn(0x7f335013dfe0 0x7f335015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 -- 172.21.15.114:0/372350498 >> v2:172.21.15.130:3300/0 conn(0x7f335013dfe0 msgr2=0x7f335015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 --2- 172.21.15.114:0/372350498 >> v2:172.21.15.130:3300/0 conn(0x7f335013dfe0 0x7f335015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 -- 172.21.15.114:0/372350498 >> v1:172.21.15.130:6789/0 conn(0x7f3350072f20 legacy=0x7f335006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.684+0000 7f3355448640 1 -- 172.21.15.114:0/372350498 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33500cd0b0 con 0x7f335015f820 2024-04-13T02:45:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.685+0000 7f3355448640 1 --2- 172.21.15.114:0/372350498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335015f820 0x7f33500729e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f335006f270 tx=0x7f334002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ec5576f00eef57 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.685+0000 7f3354c47640 1 -- 172.21.15.114:0/372350498 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334003b070 con 0x7f335015f820 2024-04-13T02:45:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.685+0000 7f3354c47640 1 -- 172.21.15.114:0/372350498 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3340036440 con 0x7f335015f820 2024-04-13T02:45:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.685+0000 7f3354c47640 1 -- 172.21.15.114:0/372350498 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340036810 con 0x7f335015f820 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 -- 172.21.15.114:0/372350498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335015f820 msgr2=0x7f33500729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 --2- 172.21.15.114:0/372350498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335015f820 0x7f33500729e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f335006f270 tx=0x7f334002e170 comp rx=0 tx=0).stop 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 -- 172.21.15.114:0/372350498 shutdown_connections 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 --2- 172.21.15.114:0/372350498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335015f820 0x7f33500729e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 --2- 172.21.15.114:0/372350498 >> v2:172.21.15.130:3300/0 conn(0x7f335013dfe0 0x7f335015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 -- 172.21.15.114:0/372350498 >> 172.21.15.114:0/372350498 conn(0x7f33500b2460 msgr2=0x7f33500b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 -- 172.21.15.114:0/372350498 shutdown_connections 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.686+0000 7f3357ead640 1 -- 172.21.15.114:0/372350498 wait complete. 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.687+0000 7f3357ead640 1 Processor -- start 2024-04-13T02:45:13.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.687+0000 7f3357ead640 1 -- start start 2024-04-13T02:45:13.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3357ead640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3350072f20 0x7f33501f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3357ead640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 0x7f3350140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3357ead640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f335015f820 0x7f33501f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3357ead640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f335013e3c0 con 0x7f335013dfe0 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3357ead640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f33500cd670 con 0x7f3350072f20 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3357ead640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f335015c360 con 0x7f335015f820 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 0x7f3350140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 0x7f3350140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34472/0 (socket says 172.21.15.114:34472) 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 -- 172.21.15.114:0/928349810 learned_addr learned my addr 172.21.15.114:0/928349810 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355c49640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3350072f20 0x7f33501f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f335644a640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f335015f820 0x7f33501f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 -- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f335015f820 msgr2=0x7f33501f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f335015f820 0x7f33501f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 -- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3350072f20 msgr2=0x7f33501f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3350072f20 0x7f33501f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 -- 172.21.15.114:0/928349810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33501f88d0 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f335644a640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f335015f820 0x7f33501f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.688+0000 7f3355448640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 0x7f3350140400 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f334002e1b0 tx=0x7f33400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.689+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340046070 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.689+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334003d050 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.689+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33501f8bb0 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.689+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334003b030 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.689+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33501f4df0 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.690+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3350068c80 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.690+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3340049070 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.690+0000 7f33467fc640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f333406c8f0 0x7f333406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.690+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f33400ad700 con 0x7f335013dfe0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.690+0000 7f3355c49640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f333406c8f0 0x7f333406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.691+0000 7f3355c49640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f333406c8f0 0x7f333406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f334c006fd0 tx=0x7f334c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.695+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f334007bb30 con 0x7f335013dfe0 2024-04-13T02:45:13.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.868+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33500701b0 con 0x7f335013dfe0 2024-04-13T02:45:13.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.869+0000 7f33467fc640 1 -- 172.21.15.114:0/928349810 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f334007b430 con 0x7f335013dfe0 2024-04-13T02:45:13.869 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f333406c8f0 msgr2=0x7f333406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f333406c8f0 0x7f333406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f334c006fd0 tx=0x7f334c008040 comp rx=0 tx=0).stop 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 msgr2=0x7f3350140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 0x7f3350140400 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f334002e1b0 tx=0x7f33400046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 shutdown_connections 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f333406c8f0 0x7f333406edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f335015f820 0x7f33501f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f335013dfe0 0x7f3350140400 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 --2- 172.21.15.114:0/928349810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3350072f20 0x7f33501f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 >> 172.21.15.114:0/928349810 conn(0x7f33500b2460 msgr2=0x7f335013d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 shutdown_connections 2024-04-13T02:45:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.871+0000 7f3357ead640 1 -- 172.21.15.114:0/928349810 wait complete. 2024-04-13T02:45:13.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.985+0000 7f4dbce36640 1 Processor -- start 2024-04-13T02:45:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.985+0000 7f4dbce36640 1 -- start start 2024-04-13T02:45:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4dbce36640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4db81591c0 0x7f4db815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4dbce36640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4db815f5a0 0x7f4db806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4dbce36640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4db815ffe0 con 0x7f4db809ace0 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4dbce36640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4db81595a0 con 0x7f4db81591c0 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4dbce36640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4db8160220 con 0x7f4db815f5a0 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4db659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4db81591c0 0x7f4db815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4db659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4db81591c0 0x7f4db815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34474/0 (socket says 172.21.15.114:34474) 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4db659c640 1 -- 172.21.15.114:0/1782577687 learned_addr learned my addr 172.21.15.114:0/1782577687 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.986+0000 7f4db5d9b640 1 --2- 172.21.15.114:0/1782577687 >> v2:172.21.15.130:3300/0 conn(0x7f4db815f5a0 0x7f4db806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.987+0000 7f4db659c640 1 -- 172.21.15.114:0/1782577687 >> v2:172.21.15.130:3300/0 conn(0x7f4db815f5a0 msgr2=0x7f4db806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.987+0000 7f4db659c640 1 --2- 172.21.15.114:0/1782577687 >> v2:172.21.15.130:3300/0 conn(0x7f4db815f5a0 0x7f4db806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.987+0000 7f4db659c640 1 -- 172.21.15.114:0/1782577687 >> v1:172.21.15.130:6789/0 conn(0x7f4db809ace0 legacy=0x7f4db8162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:13.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.987+0000 7f4db659c640 1 -- 172.21.15.114:0/1782577687 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db815fa20 con 0x7f4db81591c0 2024-04-13T02:45:13.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.987+0000 7f4db659c640 1 --2- 172.21.15.114:0/1782577687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db81591c0 0x7f4db815f060 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4db8069730 tx=0x7f4da802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86cdfa905eff2cf server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.987+0000 7f4db559a640 1 -- 172.21.15.114:0/1782577687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8034070 con 0x7f4db81591c0 2024-04-13T02:45:13.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4db559a640 1 -- 172.21.15.114:0/1782577687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8030860 con 0x7f4db81591c0 2024-04-13T02:45:13.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4db559a640 1 -- 172.21.15.114:0/1782577687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8030c30 con 0x7f4db81591c0 2024-04-13T02:45:13.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 -- 172.21.15.114:0/1782577687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db81591c0 msgr2=0x7f4db815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 --2- 172.21.15.114:0/1782577687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db81591c0 0x7f4db815f060 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4db8069730 tx=0x7f4da802b9a0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 -- 172.21.15.114:0/1782577687 shutdown_connections 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 --2- 172.21.15.114:0/1782577687 >> v2:172.21.15.130:3300/0 conn(0x7f4db815f5a0 0x7f4db806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 --2- 172.21.15.114:0/1782577687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db81591c0 0x7f4db815f060 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 -- 172.21.15.114:0/1782577687 >> 172.21.15.114:0/1782577687 conn(0x7f4db80b7eb0 msgr2=0x7f4db80b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 -- 172.21.15.114:0/1782577687 shutdown_connections 2024-04-13T02:45:13.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.988+0000 7f4dbce36640 1 -- 172.21.15.114:0/1782577687 wait complete. 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.989+0000 7f4dbce36640 1 Processor -- start 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 -- start start 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 0x7f4db80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4db81591c0 0x7f4db80d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4db815f5a0 0x7f4db80d3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80b6640 con 0x7f4db809ace0 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80b6360 con 0x7f4db81591c0 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4dbce36640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4db80b7b70 con 0x7f4db815f5a0 2024-04-13T02:45:13.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4db659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 0x7f4db80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4db659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 0x7f4db80b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34482/0 (socket says 172.21.15.114:34482) 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.990+0000 7f4db659c640 1 -- 172.21.15.114:0/380668897 learned_addr learned my addr 172.21.15.114:0/380668897 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db6d9d640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4db815f5a0 0x7f4db80d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db5d9b640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4db81591c0 0x7f4db80d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db659c640 1 -- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4db815f5a0 msgr2=0x7f4db80d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db659c640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4db815f5a0 0x7f4db80d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db659c640 1 -- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4db81591c0 msgr2=0x7f4db80d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db659c640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4db81591c0 0x7f4db80d2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db659c640 1 -- 172.21.15.114:0/380668897 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db80b04c0 con 0x7f4db809ace0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db5d9b640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4db81591c0 0x7f4db80d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db6d9d640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4db815f5a0 0x7f4db80d3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4db659c640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 0x7f4db80b2300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4da802b9e0 tx=0x7f4da8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8048070 con 0x7f4db809ace0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8030660 con 0x7f4db809ace0 2024-04-13T02:45:13.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8034040 con 0x7f4db809ace0 2024-04-13T02:45:13.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db80b07a0 con 0x7f4db809ace0 2024-04-13T02:45:13.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.991+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db80b0d60 con 0x7f4db809ace0 2024-04-13T02:45:13.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.992+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db80b0f30 con 0x7f4db809ace0 2024-04-13T02:45:13.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.992+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4da8037070 con 0x7f4db809ace0 2024-04-13T02:45:13.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.993+0000 7f4da6ffd640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d9806c8f0 0x7f4d9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:13.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.993+0000 7f4db5d9b640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d9806c8f0 0x7f4d9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:13.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.993+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4da80ada70 con 0x7f4db809ace0 2024-04-13T02:45:13.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.993+0000 7f4db5d9b640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d9806c8f0 0x7f4d9806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4dac006fd0 tx=0x7f4dac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:13.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:13.997+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4da807c050 con 0x7f4db809ace0 2024-04-13T02:45:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.171+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4db8158830 con 0x7f4db809ace0 2024-04-13T02:45:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.171+0000 7f4da6ffd640 1 -- 172.21.15.114:0/380668897 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f4da807b950 con 0x7f4db809ace0 2024-04-13T02:45:14.172 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d9806c8f0 msgr2=0x7f4d9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d9806c8f0 0x7f4d9806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4dac006fd0 tx=0x7f4dac008040 comp rx=0 tx=0).stop 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 msgr2=0x7f4db80b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 0x7f4db80b2300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4da802b9e0 tx=0x7f4da8004730 comp rx=0 tx=0).stop 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 shutdown_connections 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4d9806c8f0 0x7f4d9806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4db815f5a0 0x7f4db80d3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4db81591c0 0x7f4db80d2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 --2- 172.21.15.114:0/380668897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db809ace0 0x7f4db80b2300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 >> 172.21.15.114:0/380668897 conn(0x7f4db80b7eb0 msgr2=0x7f4db8071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 shutdown_connections 2024-04-13T02:45:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.173+0000 7f4dbce36640 1 -- 172.21.15.114:0/380668897 wait complete. 2024-04-13T02:45:14.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:14.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.287+0000 7f1652e80640 1 Processor -- start 2024-04-13T02:45:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.287+0000 7f1652e80640 1 -- start start 2024-04-13T02:45:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1652e80640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f164c0ce320 0x7f164c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1652e80640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c0b4a40 0x7f164c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1652e80640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164c068210 con 0x7f164c15b9e0 2024-04-13T02:45:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1652e80640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f164c0b4280 con 0x7f164c0ce320 2024-04-13T02:45:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1652e80640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f164c067c50 con 0x7f164c0b4a40 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1650c1c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f164c15b9e0 0x7f164c06cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48684/0 (socket says 172.21.15.114:48684) 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f1650c1c640 1 -- 172.21.15.114:0/482399841 learned_addr learned my addr 172.21.15.114:0/482399841 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164bfff640 1 --2- 172.21.15.114:0/482399841 >> v2:172.21.15.130:3300/0 conn(0x7f164c0ce320 0x7f164c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f165141d640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c0b4a40 0x7f164c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164b7fe640 1 -- 172.21.15.114:0/482399841 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67927897 0 0) 0x7f164c068210 con 0x7f164c15b9e0 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164b7fe640 1 -- 172.21.15.114:0/482399841 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f163c003520 con 0x7f164c15b9e0 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164bfff640 1 -- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c0b4a40 msgr2=0x7f164c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164b7fe640 1 -- 172.21.15.114:0/482399841 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1958020231 0 0) 0x7f163c003520 con 0x7f164c15b9e0 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164bfff640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c0b4a40 0x7f164c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164bfff640 1 -- 172.21.15.114:0/482399841 >> v1:172.21.15.114:6789/0 conn(0x7f164c15b9e0 legacy=0x7f164c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f164bfff640 1 -- 172.21.15.114:0/482399841 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c067f30 con 0x7f164c0ce320 2024-04-13T02:45:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.288+0000 7f165141d640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c0b4a40 0x7f164c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.289+0000 7f164bfff640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c0ce7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f16380097a0 tx=0x7f163802b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ee56db195748f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.289+0000 7f164b7fe640 1 -- 172.21.15.114:0/482399841 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638037070 con 0x7f164c0ce320 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.289+0000 7f164b7fe640 1 -- 172.21.15.114:0/482399841 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1638030510 con 0x7f164c0ce320 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.289+0000 7f164b7fe640 1 -- 172.21.15.114:0/482399841 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163802be60 con 0x7f164c0ce320 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 -- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 msgr2=0x7f164c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c0ce7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f16380097a0 tx=0x7f163802b660 comp rx=0 tx=0).stop 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 -- 172.21.15.114:0/482399841 shutdown_connections 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c0b4a40 0x7f164c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 --2- 172.21.15.114:0/482399841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c0ce7b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 -- 172.21.15.114:0/482399841 >> 172.21.15.114:0/482399841 conn(0x7f164c06ea10 msgr2=0x7f164c06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:14.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 -- 172.21.15.114:0/482399841 shutdown_connections 2024-04-13T02:45:14.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.290+0000 7f1652e80640 1 -- 172.21.15.114:0/482399841 wait complete. 2024-04-13T02:45:14.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.291+0000 7f1652e80640 1 Processor -- start 2024-04-13T02:45:14.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.291+0000 7f1652e80640 1 -- start start 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1652e80640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 0x7f164c154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1652e80640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c1e6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1652e80640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c15b9e0 0x7f164c1e7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1652e80640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f164c0b6010 con 0x7f164c0b4a40 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1652e80640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f164c15bdc0 con 0x7f164c0ce320 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1652e80640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f164c0b6190 con 0x7f164c15b9e0 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 0x7f164c154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 0x7f164c154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34492/0 (socket says 172.21.15.114:34492) 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 -- 172.21.15.114:0/2139753885 learned_addr learned my addr 172.21.15.114:0/2139753885 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f164bfff640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c1e6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f165141d640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c15b9e0 0x7f164c1e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 -- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c15b9e0 msgr2=0x7f164c1e7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c15b9e0 0x7f164c1e7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 -- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 msgr2=0x7f164c1e6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c1e6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f1650c1c640 1 -- 172.21.15.114:0/2139753885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c157820 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f165141d640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c15b9e0 0x7f164c1e7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.292+0000 7f164bfff640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c1e6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.293+0000 7f1650c1c640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 0x7f164c154d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f164000cb20 tx=0x7f1640007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.293+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640017070 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.293+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1640005ce0 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.293+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c06bab0 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.293+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640007290 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.293+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c06c050 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.294+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c152eb0 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.294+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f164001a070 con 0x7f164c0b4a40 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.294+0000 7f16497fa640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f163006c8f0 0x7f163006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.295+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f164008b200 con 0x7f164c0b4a40 2024-04-13T02:45:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.295+0000 7f164bfff640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f163006c8f0 0x7f163006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.295+0000 7f164bfff640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f163006c8f0 0x7f163006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1638034000 tx=0x7f1638008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:14.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.299+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f164c157820 con 0x7f164c0b4a40 2024-04-13T02:45:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.473+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f164c0cdb50 con 0x7f164c0b4a40 2024-04-13T02:45:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.474+0000 7f16497fa640 1 -- 172.21.15.114:0/2139753885 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1640059630 con 0x7f164c0b4a40 2024-04-13T02:45:14.475 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:14.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.475+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f163006c8f0 msgr2=0x7f163006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.475+0000 7f1652e80640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f163006c8f0 0x7f163006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1638034000 tx=0x7f1638008030 comp rx=0 tx=0).stop 2024-04-13T02:45:14.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.475+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 msgr2=0x7f164c154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.475+0000 7f1652e80640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 0x7f164c154d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f164000cb20 tx=0x7f1640007e50 comp rx=0 tx=0).stop 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 shutdown_connections 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f163006c8f0 0x7f163006edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f164c15b9e0 0x7f164c1e7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f164c0ce320 0x7f164c1e6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 --2- 172.21.15.114:0/2139753885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f164c0b4a40 0x7f164c154d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 >> 172.21.15.114:0/2139753885 conn(0x7f164c06ea10 msgr2=0x7f164c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 shutdown_connections 2024-04-13T02:45:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.476+0000 7f1652e80640 1 -- 172.21.15.114:0/2139753885 wait complete. 2024-04-13T02:45:14.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T02:45:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.588+0000 7f76bbd88640 1 Processor -- start 2024-04-13T02:45:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.588+0000 7f76bbd88640 1 -- start start 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76bbd88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b40d0d10 0x7f76b40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76bbd88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76b4070b80 0x7f76b4070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76bbd88640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b409b8f0 con 0x7f76b415c9d0 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76bbd88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f76b4070410 con 0x7f76b4070b80 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76bbd88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f76b409bbd0 con 0x7f76b40d0d10 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76ba325640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76b4070b80 0x7f76b4070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76ba325640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76b4070b80 0x7f76b4070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34494/0 (socket says 172.21.15.114:34494) 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.589+0000 7f76ba325640 1 -- 172.21.15.114:0/2838591124 learned_addr learned my addr 172.21.15.114:0/2838591124 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76b9323640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b40d0d10 0x7f76b40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76ba325640 1 -- 172.21.15.114:0/2838591124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b40d0d10 msgr2=0x7f76b40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76ba325640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b40d0d10 0x7f76b40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76ba325640 1 -- 172.21.15.114:0/2838591124 >> v1:172.21.15.130:6789/0 conn(0x7f76b415c9d0 legacy=0x7f76b40d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76ba325640 1 -- 172.21.15.114:0/2838591124 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b409beb0 con 0x7f76b4070b80 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76b9323640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b40d0d10 0x7f76b40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76ba325640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b4070b80 0x7f76b4070fd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009870 tx=0x7f76ac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df19da4ab830f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.590+0000 7f76b8b22640 1 -- 172.21.15.114:0/2838591124 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac034070 con 0x7f76b4070b80 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76b8b22640 1 -- 172.21.15.114:0/2838591124 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac030840 con 0x7f76b4070b80 2024-04-13T02:45:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76b8b22640 1 -- 172.21.15.114:0/2838591124 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac030c10 con 0x7f76b4070b80 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 -- 172.21.15.114:0/2838591124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b4070b80 msgr2=0x7f76b4070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b4070b80 0x7f76b4070fd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009870 tx=0x7f76ac02b980 comp rx=0 tx=0).stop 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 -- 172.21.15.114:0/2838591124 shutdown_connections 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b40d0d10 0x7f76b40d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 --2- 172.21.15.114:0/2838591124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b4070b80 0x7f76b4070fd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 -- 172.21.15.114:0/2838591124 >> 172.21.15.114:0/2838591124 conn(0x7f76b40d2750 msgr2=0x7f76b40d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 -- 172.21.15.114:0/2838591124 shutdown_connections 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.591+0000 7f76bbd88640 1 -- 172.21.15.114:0/2838591124 wait complete. 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.592+0000 7f76bbd88640 1 Processor -- start 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.592+0000 7f76bbd88640 1 -- start start 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76bbd88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b4070b80 0x7f76b40b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76bbd88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 0x7f76b415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76bbd88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76b415c9d0 0x7f76b40cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76bbd88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76b409b5a0 con 0x7f76b40d0d10 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76bbd88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f76b40d0a30 con 0x7f76b415c9d0 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76bbd88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f76b415cdb0 con 0x7f76b4070b80 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76b9323640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 0x7f76b415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76b9323640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 0x7f76b415f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34506/0 (socket says 172.21.15.114:34506) 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76b9323640 1 -- 172.21.15.114:0/1589774334 learned_addr learned my addr 172.21.15.114:0/1589774334 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76ba325640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76b415c9d0 0x7f76b40cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76b9b24640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b4070b80 0x7f76b40b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.593+0000 7f76b9323640 1 -- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b4070b80 msgr2=0x7f76b40b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76b9323640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b4070b80 0x7f76b40b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76b9323640 1 -- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76b415c9d0 msgr2=0x7f76b40cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76b9323640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76b415c9d0 0x7f76b40cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76b9323640 1 -- 172.21.15.114:0/1589774334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b415fc00 con 0x7f76b40d0d10 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76b9b24640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b4070b80 0x7f76b40b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76b9323640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 0x7f76b415f120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f76a400c820 tx=0x7f76a400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a4015070 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a4007a30 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b415fee0 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a4007de0 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.594+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b40b5440 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.595+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b4068c80 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.595+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76a4018070 con 0x7f76b40d0d10 2024-04-13T02:45:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.596+0000 7f76aa7fc640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f769806c920 0x7f769806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.596+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f76a408b900 con 0x7f76b40d0d10 2024-04-13T02:45:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.596+0000 7f76b9b24640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f769806c920 0x7f769806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.596+0000 7f76b9b24640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f769806c920 0x7f769806ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f76b0001e00 tx=0x7f76b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.600+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76a40596e0 con 0x7f76b40d0d10 2024-04-13T02:45:14.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.789+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76b40b3c40 con 0x7f76b40d0d10 2024-04-13T02:45:14.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.789+0000 7f76aa7fc640 1 -- 172.21.15.114:0/1589774334 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f76a405d9e0 con 0x7f76b40d0d10 2024-04-13T02:45:14.790 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-13T02:45:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f769806c920 msgr2=0x7f769806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f769806c920 0x7f769806ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f76b0001e00 tx=0x7f76b0009040 comp rx=0 tx=0).stop 2024-04-13T02:45:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 msgr2=0x7f76b415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 0x7f76b415f120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f76a400c820 tx=0x7f76a400cce0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 shutdown_connections 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f76b415c9d0 0x7f76b40cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76b40d0d10 0x7f76b415f120 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f769806c920 0x7f769806ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 --2- 172.21.15.114:0/1589774334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f76b4070b80 0x7f76b40b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 >> 172.21.15.114:0/1589774334 conn(0x7f76b40d2750 msgr2=0x7f76b415bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 shutdown_connections 2024-04-13T02:45:14.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.791+0000 7f76bbd88640 1 -- 172.21.15.114:0/1589774334 wait complete. 2024-04-13T02:45:14.803 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-13T02:45:14.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:14.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-13T02:45:14.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:45:14.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:14.837 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-13T02:45:14.895 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-13T02:45:14.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.996+0000 7fcafe6b7640 1 Processor -- start 2024-04-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.996+0000 7fcafe6b7640 1 -- start start 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcafe6b7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaf81461f0 0x7fcaf80ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcafe6b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf80b3fe0 0x7fcaf815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcafe6b7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf80b4be0 con 0x7fcaf80cedf0 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcafe6b7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf80a9640 con 0x7fcaf81461f0 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcafe6b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf80cf250 con 0x7fcaf80b3fe0 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaf81461f0 0x7fcaf80ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaf81461f0 0x7fcaf80ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34508/0 (socket says 172.21.15.114:34508) 2024-04-13T02:45:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 -- 172.21.15.114:0/2572402416 learned_addr learned my addr 172.21.15.114:0/2572402416 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcafcc54640 1 --2- 172.21.15.114:0/2572402416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf80b3fe0 0x7fcaf815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 -- 172.21.15.114:0/2572402416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf80b3fe0 msgr2=0x7fcaf815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 --2- 172.21.15.114:0/2572402416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf80b3fe0 0x7fcaf815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 -- 172.21.15.114:0/2572402416 >> v1:172.21.15.130:6789/0 conn(0x7fcaf80cedf0 legacy=0x7fcaf80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.997+0000 7fcaf7fff640 1 -- 172.21.15.114:0/2572402416 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf80b4620 con 0x7fcaf81461f0 2024-04-13T02:45:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.998+0000 7fcaf7fff640 1 --2- 172.21.15.114:0/2572402416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf81461f0 0x7fcaf80ce8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009870 tx=0x7fcaec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4238822d8ef4342d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.998+0000 7fcaf6ffd640 1 -- 172.21.15.114:0/2572402416 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec034070 con 0x7fcaf81461f0 2024-04-13T02:45:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.998+0000 7fcaf6ffd640 1 -- 172.21.15.114:0/2572402416 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaec030840 con 0x7fcaf81461f0 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.998+0000 7fcaf6ffd640 1 -- 172.21.15.114:0/2572402416 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec030c10 con 0x7fcaf81461f0 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 -- 172.21.15.114:0/2572402416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf81461f0 msgr2=0x7fcaf80ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/2572402416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf81461f0 0x7fcaf80ce8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009870 tx=0x7fcaec02b980 comp rx=0 tx=0).stop 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 -- 172.21.15.114:0/2572402416 shutdown_connections 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/2572402416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf80b3fe0 0x7fcaf815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/2572402416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf81461f0 0x7fcaf80ce8b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 -- 172.21.15.114:0/2572402416 >> 172.21.15.114:0/2572402416 conn(0x7fcaf80b27b0 msgr2=0x7fcaf80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 -- 172.21.15.114:0/2572402416 shutdown_connections 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:14.999+0000 7fcafe6b7640 1 -- 172.21.15.114:0/2572402416 wait complete. 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.000+0000 7fcafe6b7640 1 Processor -- start 2024-04-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.000+0000 7fcafe6b7640 1 -- start start 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaf80b3fe0 0x7fcaf80cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 0x7fcaf81e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf81461f0 0x7fcaf81e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf815d290 con 0x7fcaf80cedf0 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf815cfb0 con 0x7fcaf80b3fe0 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf81465d0 con 0x7fcaf81461f0 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 0x7fcaf81e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 0x7fcaf81e7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34524/0 (socket says 172.21.15.114:34524) 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 -- 172.21.15.114:0/145437569 learned_addr learned my addr 172.21.15.114:0/145437569 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf7fff640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaf80b3fe0 0x7fcaf80cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafcc54640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf81461f0 0x7fcaf81e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 -- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf81461f0 msgr2=0x7fcaf81e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf81461f0 0x7fcaf81e8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 -- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaf80b3fe0 msgr2=0x7fcaf80cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaf80b3fe0 0x7fcaf80cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 -- 172.21.15.114:0/145437569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf80c8b00 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf77fe640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 0x7fcaf81e7ec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcae800c430 tx=0x7fcae800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8011790 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae8017070 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf812f0a0 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.001+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8011bb0 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.002+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf812f660 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.003+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf8068c80 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.003+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcae801c460 con 0x7fcaf80cedf0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.003+0000 7fcaf4ff9640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcae406c8f0 0x7fcae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.003+0000 7fcaf7fff640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcae406c8f0 0x7fcae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.003+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcae808b870 con 0x7fcaf80cedf0 2024-04-13T02:45:15.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.004+0000 7fcaf7fff640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcae406c8f0 0x7fcae406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcaec036000 tx=0x7fcaec03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.007+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcae8059650 con 0x7fcaf80cedf0 2024-04-13T02:45:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.218+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaf80c6550 con 0x7fcaf80cedf0 2024-04-13T02:45:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.218+0000 7fcaf4ff9640 1 -- 172.21.15.114:0/145437569 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7fcae805d950 con 0x7fcaf80cedf0 2024-04-13T02:45:15.219 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:15.219 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:45:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcae406c8f0 msgr2=0x7fcae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcae406c8f0 0x7fcae406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcaec036000 tx=0x7fcaec03b040 comp rx=0 tx=0).stop 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 msgr2=0x7fcaf81e7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 0x7fcaf81e7ec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcae800c430 tx=0x7fcae800c8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 shutdown_connections 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcae406c8f0 0x7fcae406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaf81461f0 0x7fcaf81e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf80cedf0 0x7fcaf81e7ec0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 --2- 172.21.15.114:0/145437569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaf80b3fe0 0x7fcaf80cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 >> 172.21.15.114:0/145437569 conn(0x7fcaf80b27b0 msgr2=0x7fcaf80c6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 shutdown_connections 2024-04-13T02:45:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.220+0000 7fcafe6b7640 1 -- 172.21.15.114:0/145437569 wait complete. 2024-04-13T02:45:15.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.332+0000 7f7486b15640 1 Processor -- start 2024-04-13T02:45:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.332+0000 7f7486b15640 1 -- start start 2024-04-13T02:45:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.333+0000 7f7486b15640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 0x7f74800d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.333+0000 7f7486b15640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74800b3470 0x7f74800b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.333+0000 7f7486b15640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74800d2d90 con 0x7f748015eac0 2024-04-13T02:45:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.333+0000 7f7486b15640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f74800d1cd0 con 0x7f74800b3470 2024-04-13T02:45:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.333+0000 7f7486b15640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f74800d3070 con 0x7f74800d1300 2024-04-13T02:45:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74800b3470 0x7f74800b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f747ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 0x7f74800d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74800b3470 0x7f74800b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:39962/0 (socket says 172.21.15.114:39962) 2024-04-13T02:45:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74848b1640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f748015eac0 0x7f74800d3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56396/0 (socket says 172.21.15.114:56396) 2024-04-13T02:45:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f747ffff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 0x7f74800d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:58948/0 (socket says 172.21.15.114:58948) 2024-04-13T02:45:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 -- 172.21.15.114:0/3053301950 learned_addr learned my addr 172.21.15.114:0/3053301950 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 -- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 msgr2=0x7f74800d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 --2- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 0x7f74800d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 -- 172.21.15.114:0/3053301950 >> v1:172.21.15.130:6789/0 conn(0x7f748015eac0 legacy=0x7f74800d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f74850b2640 1 -- 172.21.15.114:0/3053301950 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74800d3350 con 0x7f74800b3470 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.334+0000 7f747ffff640 1 --2- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 0x7f74800d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f74850b2640 1 --2- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800b3470 0x7f74800b38e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7478009e50 tx=0x7f747802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce21c156dbd7ac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f747f7fe640 1 -- 172.21.15.114:0/3053301950 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747802cb00 con 0x7f74800b3470 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f747f7fe640 1 -- 172.21.15.114:0/3053301950 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747802cca0 con 0x7f74800b3470 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f747f7fe640 1 -- 172.21.15.114:0/3053301950 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478034610 con 0x7f74800b3470 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 -- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800b3470 msgr2=0x7f74800b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 --2- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800b3470 0x7f74800b38e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7478009e50 tx=0x7f747802bf60 comp rx=0 tx=0).stop 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 -- 172.21.15.114:0/3053301950 shutdown_connections 2024-04-13T02:45:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 --2- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800b3470 0x7f74800b38e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 --2- 172.21.15.114:0/3053301950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800d1300 0x7f74800d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 -- 172.21.15.114:0/3053301950 >> 172.21.15.114:0/3053301950 conn(0x7f7480073690 msgr2=0x7f748006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.335+0000 7f7486b15640 1 -- 172.21.15.114:0/3053301950 shutdown_connections 2024-04-13T02:45:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.336+0000 7f7486b15640 1 -- 172.21.15.114:0/3053301950 wait complete. 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 Processor -- start 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 -- start start 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800b3470 0x7f748015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800d1300 0x7f748014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 0x7f748014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f748015eea0 con 0x7f748015eac0 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74800d3910 con 0x7f74800d1300 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.337+0000 7f7486b15640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f74800d4590 con 0x7f74800b3470 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 0x7f748014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 0x7f748014ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34532/0 (socket says 172.21.15.114:34532) 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 -- 172.21.15.114:0/3488697434 learned_addr learned my addr 172.21.15.114:0/3488697434 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74848b1640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800b3470 0x7f748015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f747ffff640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800d1300 0x7f748014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 -- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800b3470 msgr2=0x7f748015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800b3470 0x7f748015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 -- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800d1300 msgr2=0x7f748014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800d1300 0x7f748014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 -- 172.21.15.114:0/3488697434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74800b4870 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f74850b2640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 0x7f748014ef20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7478036040 tx=0x7f7478004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478043020 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747802ce50 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74800b4b50 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478009510 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.338+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74800b5110 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.339+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7480068c80 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.340+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7478046020 con 0x7f748015eac0 2024-04-13T02:45:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.340+0000 7f747d7fa640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f746c06c8f0 0x7f746c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.340+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f74780ae130 con 0x7f748015eac0 2024-04-13T02:45:15.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.340+0000 7f74848b1640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f746c06c8f0 0x7f746c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.341+0000 7f74848b1640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f746c06c8f0 0x7f746c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7470000f60 tx=0x7f7470007ce0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.344+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f747804d030 con 0x7f748015eac0 2024-04-13T02:45:15.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.521+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74800b6bb0 con 0x7f748015eac0 2024-04-13T02:45:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.522+0000 7f747d7fa640 1 -- 172.21.15.114:0/3488697434 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f747803c350 con 0x7f748015eac0 2024-04-13T02:45:15.523 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:15.523 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f746c06c8f0 msgr2=0x7f746c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f746c06c8f0 0x7f746c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7470000f60 tx=0x7f7470007ce0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 msgr2=0x7f748014ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 0x7f748014ef20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7478036040 tx=0x7f7478004a40 comp rx=0 tx=0).stop 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 shutdown_connections 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f748015eac0 0x7f748014ef20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74800d1300 0x7f748014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f746c06c8f0 0x7f746c06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 --2- 172.21.15.114:0/3488697434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74800b3470 0x7f748015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 >> 172.21.15.114:0/3488697434 conn(0x7f7480073690 msgr2=0x7f74800d3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 shutdown_connections 2024-04-13T02:45:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.524+0000 7f7486b15640 1 -- 172.21.15.114:0/3488697434 wait complete. 2024-04-13T02:45:15.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:44:37.527771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:44:38.517825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:15.536 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.639+0000 7f84efc77640 1 Processor -- start 2024-04-13T02:45:15.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.639+0000 7f84efc77640 1 -- start start 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84efc77640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e80b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84efc77640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e80b6150 0x7f84e806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84efc77640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e80b41f0 con 0x7f84e80b5830 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84efc77640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f84e815f390 con 0x7f84e80b6150 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84efc77640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f84e80b4e00 con 0x7f84e8067a40 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e80b6150 0x7f84e806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e80b6150 0x7f84e806b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34534/0 (socket says 172.21.15.114:34534) 2024-04-13T02:45:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 -- 172.21.15.114:0/3175521131 learned_addr learned my addr 172.21.15.114:0/3175521131 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 -- 172.21.15.114:0/3175521131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 msgr2=0x7f84e80b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ed212640 1 --2- 172.21.15.114:0/3175521131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e80b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 --2- 172.21.15.114:0/3175521131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e80b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 -- 172.21.15.114:0/3175521131 >> v1:172.21.15.130:6789/0 conn(0x7f84e80b5830 legacy=0x7f84e815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.640+0000 7f84ee214640 1 -- 172.21.15.114:0/3175521131 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e80b44d0 con 0x7f84e80b6150 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.641+0000 7f84ee214640 1 --2- 172.21.15.114:0/3175521131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b6150 0x7f84e806b9c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009e50 tx=0x7f84e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9018904a3a1cb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.641+0000 7f84eca11640 1 -- 172.21.15.114:0/3175521131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e002ca70 con 0x7f84e80b6150 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.641+0000 7f84eca11640 1 -- 172.21.15.114:0/3175521131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e002cc10 con 0x7f84e80b6150 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.641+0000 7f84eca11640 1 -- 172.21.15.114:0/3175521131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00343f0 con 0x7f84e80b6150 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 -- 172.21.15.114:0/3175521131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b6150 msgr2=0x7f84e806b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 --2- 172.21.15.114:0/3175521131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b6150 0x7f84e806b9c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009e50 tx=0x7f84e002bed0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 -- 172.21.15.114:0/3175521131 shutdown_connections 2024-04-13T02:45:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 --2- 172.21.15.114:0/3175521131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e80b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 --2- 172.21.15.114:0/3175521131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b6150 0x7f84e806b9c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 -- 172.21.15.114:0/3175521131 >> 172.21.15.114:0/3175521131 conn(0x7f84e806ea10 msgr2=0x7f84e806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 -- 172.21.15.114:0/3175521131 shutdown_connections 2024-04-13T02:45:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.642+0000 7f84efc77640 1 -- 172.21.15.114:0/3175521131 wait complete. 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.643+0000 7f84efc77640 1 Processor -- start 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.643+0000 7f84efc77640 1 -- start start 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84efc77640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e8145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84efc77640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 0x7f84e8157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84efc77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84e80b6150 0x7f84e80aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84efc77640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f84e806bf00 con 0x7f84e80b5830 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84efc77640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f84e80b4a90 con 0x7f84e80b6150 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84efc77640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f84e806c080 con 0x7f84e8067a40 2024-04-13T02:45:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 0x7f84e8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 0x7f84e8157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34544/0 (socket says 172.21.15.114:34544) 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 -- 172.21.15.114:0/508322625 learned_addr learned my addr 172.21.15.114:0/508322625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84eda13640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e8145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ee214640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84e80b6150 0x7f84e80aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 -- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 msgr2=0x7f84e8145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e8145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 -- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84e80b6150 msgr2=0x7f84e80aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84e80b6150 0x7f84e80aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 -- 172.21.15.114:0/508322625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e8159a30 con 0x7f84e80b5830 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84ed212640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 0x7f84e8157150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c7f0 tx=0x7f84d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8015070 con 0x7f84e80b5830 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8004240 con 0x7f84e80b5830 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.644+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8007620 con 0x7f84e80b5830 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.645+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e8159d10 con 0x7f84e80b5830 2024-04-13T02:45:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.645+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e80cdef0 con 0x7f84e80b5830 2024-04-13T02:45:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.646+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e815a230 con 0x7f84e80b5830 2024-04-13T02:45:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.646+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84d80079d0 con 0x7f84e80b5830 2024-04-13T02:45:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.646+0000 7f84de7fc640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f84cc06c8f0 0x7f84cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.647+0000 7f84eda13640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f84cc06c8f0 0x7f84cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.647+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84d808bf30 con 0x7f84e80b5830 2024-04-13T02:45:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.647+0000 7f84eda13640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f84cc06c8f0 0x7f84cc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84e4004f60 tx=0x7f84e4007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.651+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84e815a230 con 0x7f84e80b5830 2024-04-13T02:45:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.824+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f84e8068c80 con 0x7f84e80b5830 2024-04-13T02:45:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.825+0000 7f84de7fc640 1 -- 172.21.15.114:0/508322625 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f84d8059d10 con 0x7f84e80b5830 2024-04-13T02:45:15.826 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f84cc06c8f0 msgr2=0x7f84cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f84cc06c8f0 0x7f84cc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84e4004f60 tx=0x7f84e4007e30 comp rx=0 tx=0).stop 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 msgr2=0x7f84e8157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 0x7f84e8157150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c7f0 tx=0x7f84d800ccb0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 shutdown_connections 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84e80b6150 0x7f84e80aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e80b5830 0x7f84e8157150 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f84cc06c8f0 0x7f84cc06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 --2- 172.21.15.114:0/508322625 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84e8067a40 0x7f84e8145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 >> 172.21.15.114:0/508322625 conn(0x7f84e806ea10 msgr2=0x7f84e80afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 shutdown_connections 2024-04-13T02:45:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.827+0000 7f84efc77640 1 -- 172.21.15.114:0/508322625 wait complete. 2024-04-13T02:45:15.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.940+0000 7f0ae3cde640 1 Processor -- start 2024-04-13T02:45:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.940+0000 7f0ae3cde640 1 -- start start 2024-04-13T02:45:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae3cde640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc148580 0x7f0adc0af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae3cde640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0adc0b52d0 0x7f0adc06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae3cde640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0adc0b0180 con 0x7f0adc073020 2024-04-13T02:45:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae3cde640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0adc0b0460 con 0x7f0adc0b52d0 2024-04-13T02:45:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae3cde640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc06e5f0 con 0x7f0adc148580 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae1a7a640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc148580 0x7f0adc0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae227b640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0adc0b52d0 0x7f0adc06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae1279640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0adc073020 0x7f0adc0b4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56416/0 (socket says 172.21.15.114:56416) 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.941+0000 7f0ae1279640 1 -- 172.21.15.114:0/2269830714 learned_addr learned my addr 172.21.15.114:0/2269830714 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.942+0000 7f0ae227b640 1 -- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc148580 msgr2=0x7f0adc0af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.942+0000 7f0ae227b640 1 --2- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc148580 0x7f0adc0af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.942+0000 7f0ae227b640 1 -- 172.21.15.114:0/2269830714 >> v1:172.21.15.130:6789/0 conn(0x7f0adc073020 legacy=0x7f0adc0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.942+0000 7f0ae227b640 1 -- 172.21.15.114:0/2269830714 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc06e8d0 con 0x7f0adc0b52d0 2024-04-13T02:45:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae227b640 1 --2- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc0b52d0 0x7f0adc06f0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40097a0 tx=0x7f0ad402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce8cc095bb739ec server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae0a78640 1 -- 172.21.15.114:0/2269830714 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4035020 con 0x7f0adc0b52d0 2024-04-13T02:45:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae0a78640 1 -- 172.21.15.114:0/2269830714 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad4031830 con 0x7f0adc0b52d0 2024-04-13T02:45:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae0a78640 1 -- 172.21.15.114:0/2269830714 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4031c00 con 0x7f0adc0b52d0 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 -- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc0b52d0 msgr2=0x7f0adc06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc0b52d0 0x7f0adc06f0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40097a0 tx=0x7f0ad402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 -- 172.21.15.114:0/2269830714 shutdown_connections 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc0b52d0 0x7f0adc06f0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/2269830714 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc148580 0x7f0adc0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 -- 172.21.15.114:0/2269830714 >> 172.21.15.114:0/2269830714 conn(0x7f0adc072530 msgr2=0x7f0adc072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 -- 172.21.15.114:0/2269830714 shutdown_connections 2024-04-13T02:45:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.943+0000 7f0ae3cde640 1 -- 172.21.15.114:0/2269830714 wait complete. 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 Processor -- start 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 -- start start 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc073020 0x7f0adc15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc0b52d0 0x7f0adc13d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 0x7f0adc1629c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc06f610 con 0x7f0adc148580 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc0afe70 con 0x7f0adc073020 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae3cde640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc06f790 con 0x7f0adc0b52d0 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae227b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 0x7f0adc1629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae227b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 0x7f0adc1629c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34546/0 (socket says 172.21.15.114:34546) 2024-04-13T02:45:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.945+0000 7f0ae227b640 1 -- 172.21.15.114:0/3534913756 learned_addr learned my addr 172.21.15.114:0/3534913756 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae1a7a640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc073020 0x7f0adc15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae1279640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc0b52d0 0x7f0adc13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae227b640 1 -- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc0b52d0 msgr2=0x7f0adc13d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae227b640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc0b52d0 0x7f0adc13d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae227b640 1 -- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc073020 msgr2=0x7f0adc15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae227b640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc073020 0x7f0adc15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae227b640 1 -- 172.21.15.114:0/3534913756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc13deb0 con 0x7f0adc148580 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae1a7a640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc073020 0x7f0adc15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae227b640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 0x7f0adc1629c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40097a0 tx=0x7f0ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4048070 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad403a630 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad403aa20 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0adc13e430 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.946+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0adc13fb40 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.947+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0adc0ae780 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.947+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ad404b070 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.948+0000 7f0ad27fc640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0ac006c8f0 0x7f0ac006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.948+0000 7f0ae1a7a640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0ac006c8f0 0x7f0ac006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.948+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad40ad360 con 0x7f0adc148580 2024-04-13T02:45:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.948+0000 7f0ae1a7a640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0ac006c8f0 0x7f0ac006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009fd0 tx=0x7f0ad800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:15.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:15.952+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0adc0ae780 con 0x7f0adc148580 2024-04-13T02:45:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.125+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0adc0b58e0 con 0x7f0adc148580 2024-04-13T02:45:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.125+0000 7f0ad27fc640 1 -- 172.21.15.114:0/3534913756 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f0ad4031800 con 0x7f0adc148580 2024-04-13T02:45:16.126 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.127+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0ac006c8f0 msgr2=0x7f0ac006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.127+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0ac006c8f0 0x7f0ac006edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8009fd0 tx=0x7f0ad800b040 comp rx=0 tx=0).stop 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.127+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 msgr2=0x7f0adc1629c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.127+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 0x7f0adc1629c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40097a0 tx=0x7f0ad40046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 shutdown_connections 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc148580 0x7f0adc1629c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0ac006c8f0 0x7f0ac006edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0adc0b52d0 0x7f0adc13d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 --2- 172.21.15.114:0/3534913756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0adc073020 0x7f0adc15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 >> 172.21.15.114:0/3534913756 conn(0x7f0adc072530 msgr2=0x7f0adc0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 shutdown_connections 2024-04-13T02:45:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.128+0000 7f0ae3cde640 1 -- 172.21.15.114:0/3534913756 wait complete. 2024-04-13T02:45:16.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.242+0000 7f02dab1e640 1 Processor -- start 2024-04-13T02:45:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.242+0000 7f02dab1e640 1 -- start start 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02dab1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02d415a440 0x7f02d415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02dab1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d40725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02dab1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d415d520 con 0x7f02d406fc80 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02dab1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f02d406e280 con 0x7f02d415a440 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02dab1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02d415d800 con 0x7f02d4072150 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d88ba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02d415a440 0x7f02d415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d90bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d40725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d3fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f02d406fc80 0x7f02d40cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56430/0 (socket says 172.21.15.114:56430) 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d3fff640 1 -- 172.21.15.114:0/1194347437 learned_addr learned my addr 172.21.15.114:0/1194347437 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d90bb640 1 -- 172.21.15.114:0/1194347437 >> v2:172.21.15.130:3300/0 conn(0x7f02d415a440 msgr2=0x7f02d415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d90bb640 1 --2- 172.21.15.114:0/1194347437 >> v2:172.21.15.130:3300/0 conn(0x7f02d415a440 0x7f02d415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d90bb640 1 -- 172.21.15.114:0/1194347437 >> v1:172.21.15.130:6789/0 conn(0x7f02d406fc80 legacy=0x7f02d40cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d90bb640 1 -- 172.21.15.114:0/1194347437 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d415dae0 con 0x7f02d4072150 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.243+0000 7f02d88ba640 1 --2- 172.21.15.114:0/1194347437 >> v2:172.21.15.130:3300/0 conn(0x7f02d415a440 0x7f02d415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.244+0000 7f02d90bb640 1 --2- 172.21.15.114:0/1194347437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d40725e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009d90 tx=0x7f02cc02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5246f37b971bef31 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.244+0000 7f02d37fe640 1 -- 172.21.15.114:0/1194347437 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc039070 con 0x7f02d4072150 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.244+0000 7f02d37fe640 1 -- 172.21.15.114:0/1194347437 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02cc02cc50 con 0x7f02d4072150 2024-04-13T02:45:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.244+0000 7f02d37fe640 1 -- 172.21.15.114:0/1194347437 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc034440 con 0x7f02d4072150 2024-04-13T02:45:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 -- 172.21.15.114:0/1194347437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 msgr2=0x7f02d40725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 --2- 172.21.15.114:0/1194347437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d40725e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009d90 tx=0x7f02cc02bea0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 -- 172.21.15.114:0/1194347437 shutdown_connections 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 --2- 172.21.15.114:0/1194347437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d40725e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 --2- 172.21.15.114:0/1194347437 >> v2:172.21.15.130:3300/0 conn(0x7f02d415a440 0x7f02d415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 -- 172.21.15.114:0/1194347437 >> 172.21.15.114:0/1194347437 conn(0x7f02d40b2460 msgr2=0x7f02d40b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 -- 172.21.15.114:0/1194347437 shutdown_connections 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.245+0000 7f02dab1e640 1 -- 172.21.15.114:0/1194347437 wait complete. 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.246+0000 7f02dab1e640 1 Processor -- start 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.246+0000 7f02dab1e640 1 -- start start 2024-04-13T02:45:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02dab1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d406fc80 0x7f02d4158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02dab1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d4159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02dab1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 0x7f02d41310c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02dab1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f02d415ddc0 con 0x7f02d415a440 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02dab1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02d415a820 con 0x7f02d406fc80 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02dab1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02d406f510 con 0x7f02d4072150 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 0x7f02d41310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 0x7f02d41310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34562/0 (socket says 172.21.15.114:34562) 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 -- 172.21.15.114:0/2856097387 learned_addr learned my addr 172.21.15.114:0/2856097387 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d3fff640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d88ba640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d406fc80 0x7f02d4158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 -- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 msgr2=0x7f02d4159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d4159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 -- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d406fc80 msgr2=0x7f02d4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d406fc80 0x7f02d4158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.247+0000 7f02d90bb640 1 -- 172.21.15.114:0/2856097387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d41417c0 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.248+0000 7f02d90bb640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 0x7f02d41310c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009d90 tx=0x7f02cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.248+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc039050 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.248+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02cc045070 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.248+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d4141aa0 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.248+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc009450 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.248+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d412f140 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.249+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4068c80 con 0x7f02d415a440 2024-04-13T02:45:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.249+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02cc03e610 con 0x7f02d415a440 2024-04-13T02:45:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.249+0000 7f02d17fa640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f02b806c8f0 0x7f02b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.250+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f02cc0ae630 con 0x7f02d415a440 2024-04-13T02:45:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.250+0000 7f02d88ba640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f02b806c8f0 0x7f02b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.250+0000 7f02d88ba640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f02b806c8f0 0x7f02b806edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009560 tx=0x7f02c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.254+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02cc07ca60 con 0x7f02d415a440 2024-04-13T02:45:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.429+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f02d406ef50 con 0x7f02d415a440 2024-04-13T02:45:16.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.430+0000 7f02d17fa640 1 -- 172.21.15.114:0/2856097387 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f02cc07c360 con 0x7f02d415a440 2024-04-13T02:45:16.431 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f02b806c8f0 msgr2=0x7f02b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f02b806c8f0 0x7f02b806edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009560 tx=0x7f02c8008040 comp rx=0 tx=0).stop 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 msgr2=0x7f02d41310c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 0x7f02d41310c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009d90 tx=0x7f02cc004a40 comp rx=0 tx=0).stop 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 shutdown_connections 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02d415a440 0x7f02d41310c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f02b806c8f0 0x7f02b806edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02d4072150 0x7f02d4159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 --2- 172.21.15.114:0/2856097387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02d406fc80 0x7f02d4158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 >> 172.21.15.114:0/2856097387 conn(0x7f02d40b2460 msgr2=0x7f02d40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 shutdown_connections 2024-04-13T02:45:16.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.432+0000 7f02dab1e640 1 -- 172.21.15.114:0/2856097387 wait complete. 2024-04-13T02:45:16.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:16.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.543+0000 7f2d259f0640 1 Processor -- start 2024-04-13T02:45:16.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.543+0000 7f2d259f0640 1 -- start start 2024-04-13T02:45:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d259f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d200d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d259f0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2d200d1a10 0x7f2d200b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d259f0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d200d2d90 con 0x7f2d200d43c0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d259f0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2d200d3070 con 0x7f2d200d1a10 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d259f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d200d3350 con 0x7f2d2015eac0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1e7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2d200d43c0 0x7f2d200d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48692/0 (socket says 172.21.15.114:48692) 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1e7fc640 1 -- 172.21.15.114:0/3025105171 learned_addr learned my addr 172.21.15.114:0/3025105171 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739434313 0 0) 0x7f2d200d2d90 con 0x7f2d200d43c0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1effd640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d200d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d08003520 con 0x7f2d200d43c0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3025105171 >> v2:172.21.15.130:3300/0 conn(0x7f2d200d1a10 0x7f2d200b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 709635762 0 0) 0x7f2d08003520 con 0x7f2d200d43c0 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 msgr2=0x7f2d200d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d200d3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 >> v2:172.21.15.130:3300/0 conn(0x7f2d200d1a10 msgr2=0x7f2d200b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.544+0000 7f2d1dffb640 1 --2- 172.21.15.114:0/3025105171 >> v2:172.21.15.130:3300/0 conn(0x7f2d200d1a10 0x7f2d200b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d200d3630 con 0x7f2d200d43c0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f2d14001670 con 0x7f2d200d43c0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 >> v1:172.21.15.114:6789/0 conn(0x7f2d200d43c0 legacy=0x7f2d200d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d080039b0 0x7f2d08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d08004d40 0x7f2d080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d200d3070 con 0x7f2d08004d40 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d200d3350 con 0x7f2d080039b0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0800b9c0 con 0x7f2d2015eac0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d08004d40 0x7f2d080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1effd640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d080039b0 0x7f2d08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1e7fc640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 msgr2=0x7f2d08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d080039b0 msgr2=0x7f2d08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d080039b0 0x7f2d08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3025105171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d08003520 con 0x7f2d08004d40 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.545+0000 7f2d1e7fc640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2015eac0 0x7f2d08004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d08004d40 0x7f2d080051c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009f90 tx=0x7f2d08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4413fd05e879e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18039070 con 0x7f2d08004d40 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1802cc20 con 0x7f2d08004d40 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d1dffb640 1 -- 172.21.15.114:0/3025105171 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18009c10 con 0x7f2d08004d40 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d259f0640 1 -- 172.21.15.114:0/3025105171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d08004d40 msgr2=0x7f2d080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3025105171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d08004d40 0x7f2d080051c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009f90 tx=0x7f2d08005830 comp rx=0 tx=0).stop 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3025105171 reap_dead start 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d259f0640 1 -- 172.21.15.114:0/3025105171 shutdown_connections 2024-04-13T02:45:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d259f0640 1 -- 172.21.15.114:0/3025105171 >> 172.21.15.114:0/3025105171 conn(0x7f2d20073690 msgr2=0x7f2d2006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:16.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d259f0640 1 -- 172.21.15.114:0/3025105171 shutdown_connections 2024-04-13T02:45:16.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.546+0000 7f2d259f0640 1 -- 172.21.15.114:0/3025105171 wait complete. 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.547+0000 7f2d259f0640 1 Processor -- start 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 -- start start 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d08004d40 0x7f2d2014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d200ab3f0 0x7f2d200adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 0x7f2d20150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d200d29f0 con 0x7f2d200ae230 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2015eea0 con 0x7f2d08004d40 2024-04-13T02:45:16.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.548+0000 7f2d259f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d200d2b70 con 0x7f2d200ab3f0 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 0x7f2d20150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 0x7f2d20150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34594/0 (socket says 172.21.15.114:34594) 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3111360449 learned_addr learned my addr 172.21.15.114:0/3111360449 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3111360449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d200ab3f0 msgr2=0x7f2d200adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d200ab3f0 0x7f2d200adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3111360449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d08004d40 msgr2=0x7f2d2014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d08004d40 0x7f2d2014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 -- 172.21.15.114:0/3111360449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d200ce3d0 con 0x7f2d200ae230 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d1f7fe640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 0x7f2d20150300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009f90 tx=0x7f2d18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18039030 con 0x7f2d200ae230 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d18043070 con 0x7f2d200ae230 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2014df80 con 0x7f2d200ae230 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1803d7d0 con 0x7f2d200ae230 2024-04-13T02:45:16.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.549+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d200cdb30 con 0x7f2d200ae230 2024-04-13T02:45:16.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.550+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d20068c80 con 0x7f2d200ae230 2024-04-13T02:45:16.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.550+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d1803d970 con 0x7f2d200ae230 2024-04-13T02:45:16.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.551+0000 7f2d07fff640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0c06c8f0 0x7f2d0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.551+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d180ae200 con 0x7f2d200ae230 2024-04-13T02:45:16.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.551+0000 7f2d1effd640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0c06c8f0 0x7f2d0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.551+0000 7f2d1effd640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0c06c8f0 0x7f2d0c06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009a40 tx=0x7f2d10009320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.555+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d1807c630 con 0x7f2d200ae230 2024-04-13T02:45:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.771+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d2014e270 con 0x7f2d200ae230 2024-04-13T02:45:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.771+0000 7f2d07fff640 1 -- 172.21.15.114:0/3111360449 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7f2d180ae020 con 0x7f2d200ae230 2024-04-13T02:45:16.772 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:16.772 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:45:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:45:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0c06c8f0 msgr2=0x7f2d0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0c06c8f0 0x7f2d0c06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009a40 tx=0x7f2d10009320 comp rx=0 tx=0).stop 2024-04-13T02:45:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 msgr2=0x7f2d20150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 0x7f2d20150300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009f90 tx=0x7f2d18009750 comp rx=0 tx=0).stop 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 shutdown_connections 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d200ae230 0x7f2d20150300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0c06c8f0 0x7f2d0c06edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d200ab3f0 0x7f2d200adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 --2- 172.21.15.114:0/3111360449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d08004d40 0x7f2d2014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 >> 172.21.15.114:0/3111360449 conn(0x7f2d20073690 msgr2=0x7f2d200ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 shutdown_connections 2024-04-13T02:45:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.773+0000 7f2d259f0640 1 -- 172.21.15.114:0/3111360449 wait complete. 2024-04-13T02:45:16.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:16.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.885+0000 7efd74108640 1 Processor -- start 2024-04-13T02:45:16.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.885+0000 7efd74108640 1 -- start start 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd74108640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd6c15b6d0 0x7efd6c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd74108640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c0b51f0 0x7efd6c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd74108640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c06f940 con 0x7efd6c070210 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd74108640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7efd6c06e8a0 con 0x7efd6c15b6d0 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd74108640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efd6c06eb80 con 0x7efd6c0b51f0 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd6c15b6d0 0x7efd6c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd6c15b6d0 0x7efd6c0cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34602/0 (socket says 172.21.15.114:34602) 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 -- 172.21.15.114:0/4203984752 learned_addr learned my addr 172.21.15.114:0/4203984752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd726a5640 1 --2- 172.21.15.114:0/4203984752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c0b51f0 0x7efd6c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 -- 172.21.15.114:0/4203984752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c0b51f0 msgr2=0x7efd6c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 --2- 172.21.15.114:0/4203984752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c0b51f0 0x7efd6c15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 -- 172.21.15.114:0/4203984752 >> v1:172.21.15.130:6789/0 conn(0x7efd6c070210 legacy=0x7efd6c0b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.886+0000 7efd71ea4640 1 -- 172.21.15.114:0/4203984752 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c06ee60 con 0x7efd6c15b6d0 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.887+0000 7efd71ea4640 1 --2- 172.21.15.114:0/4203984752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c15b6d0 0x7efd6c0cdd10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd68009870 tx=0x7efd6802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2029247660ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.887+0000 7efd70ea2640 1 -- 172.21.15.114:0/4203984752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd680317c0 con 0x7efd6c15b6d0 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.887+0000 7efd70ea2640 1 -- 172.21.15.114:0/4203984752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68037070 con 0x7efd6c15b6d0 2024-04-13T02:45:16.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.887+0000 7efd70ea2640 1 -- 172.21.15.114:0/4203984752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68031b80 con 0x7efd6c15b6d0 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 -- 172.21.15.114:0/4203984752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c15b6d0 msgr2=0x7efd6c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 --2- 172.21.15.114:0/4203984752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c15b6d0 0x7efd6c0cdd10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd68009870 tx=0x7efd6802b860 comp rx=0 tx=0).stop 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 -- 172.21.15.114:0/4203984752 shutdown_connections 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 --2- 172.21.15.114:0/4203984752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c0b51f0 0x7efd6c15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 --2- 172.21.15.114:0/4203984752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c15b6d0 0x7efd6c0cdd10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 -- 172.21.15.114:0/4203984752 >> 172.21.15.114:0/4203984752 conn(0x7efd6c0b27b0 msgr2=0x7efd6c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 -- 172.21.15.114:0/4203984752 shutdown_connections 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.888+0000 7efd74108640 1 -- 172.21.15.114:0/4203984752 wait complete. 2024-04-13T02:45:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.889+0000 7efd74108640 1 Processor -- start 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.889+0000 7efd74108640 1 -- start start 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c070210 0x7efd6c1f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 0x7efd6c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd6c15b6d0 0x7efd6c1f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c0ce250 con 0x7efd6c0b51f0 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c06f420 con 0x7efd6c15b6d0 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efd6c0ce3d0 con 0x7efd6c070210 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 0x7efd6c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 0x7efd6c155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34606/0 (socket says 172.21.15.114:34606) 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 -- 172.21.15.114:0/3686268823 learned_addr learned my addr 172.21.15.114:0/3686268823 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:16.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd726a5640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd6c15b6d0 0x7efd6c1f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd71ea4640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c070210 0x7efd6c1f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 -- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c070210 msgr2=0x7efd6c1f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c070210 0x7efd6c1f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 -- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd6c15b6d0 msgr2=0x7efd6c1f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd6c15b6d0 0x7efd6c1f1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 -- 172.21.15.114:0/3686268823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c1566a0 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd716a3640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 0x7efd6c155d30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00e790 tx=0x7efd5c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0041f0 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5c0043b0 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6c156980 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.890+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0116b0 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.891+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6c156f40 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.891+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd6c068c80 con 0x7efd6c0b51f0 2024-04-13T02:45:16.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.892+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd5c011850 con 0x7efd6c0b51f0 2024-04-13T02:45:16.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.892+0000 7efd627fc640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7efd5006c8f0 0x7efd5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:16.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.893+0000 7efd71ea4640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7efd5006c8f0 0x7efd5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:16.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.893+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd5c08e190 con 0x7efd6c0b51f0 2024-04-13T02:45:16.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.893+0000 7efd71ea4640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7efd5006c8f0 0x7efd5006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd68036000 tx=0x7efd6803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:16.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:16.897+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd5c016030 con 0x7efd6c0b51f0 2024-04-13T02:45:17.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.073+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd6c0d0560 con 0x7efd6c0b51f0 2024-04-13T02:45:17.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.074+0000 7efd627fc640 1 -- 172.21.15.114:0/3686268823 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7efd5c05bf70 con 0x7efd6c0b51f0 2024-04-13T02:45:17.075 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:17.075 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7efd5006c8f0 msgr2=0x7efd5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7efd5006c8f0 0x7efd5006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd68036000 tx=0x7efd6803d040 comp rx=0 tx=0).stop 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 msgr2=0x7efd6c155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 0x7efd6c155d30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00e790 tx=0x7efd5c00ec50 comp rx=0 tx=0).stop 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 shutdown_connections 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd6c15b6d0 0x7efd6c1f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd6c0b51f0 0x7efd6c155d30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7efd5006c8f0 0x7efd5006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 --2- 172.21.15.114:0/3686268823 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd6c070210 0x7efd6c1f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 >> 172.21.15.114:0/3686268823 conn(0x7efd6c0b27b0 msgr2=0x7efd6c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 shutdown_connections 2024-04-13T02:45:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.076+0000 7efd74108640 1 -- 172.21.15.114:0/3686268823 wait complete. 2024-04-13T02:45:17.088 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-13T02:45:17.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:17.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.187+0000 7faa9631e640 1 Processor -- start 2024-04-13T02:45:17.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.187+0000 7faa9631e640 1 -- start start 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa9631e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 0x7faa900b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa9631e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa900b3e10 0x7faa9015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa9631e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa900b4be0 con 0x7faa901461f0 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa9631e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7faa900a9640 con 0x7faa900b3e10 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa9631e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faa900b4620 con 0x7faa900cefc0 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa8ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faa901461f0 0x7faa900ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48704/0 (socket says 172.21.15.114:48704) 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa8ffff640 1 -- 172.21.15.114:0/3636668456 learned_addr learned my addr 172.21.15.114:0/3636668456 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa948bb640 1 --2- 172.21.15.114:0/3636668456 >> v2:172.21.15.130:3300/0 conn(0x7faa900b3e10 0x7faa9015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.188+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076095536 0 0) 0x7faa900b4be0 con 0x7faa901461f0 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8f7fe640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 0x7faa900b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa7c003520 con 0x7faa901461f0 2024-04-13T02:45:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1694240146 0 0) 0x7faa7c003520 con 0x7faa901461f0 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 msgr2=0x7faa900b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 0x7faa900b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 >> v2:172.21.15.130:3300/0 conn(0x7faa900b3e10 msgr2=0x7faa9015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 --2- 172.21.15.114:0/3636668456 >> v2:172.21.15.130:3300/0 conn(0x7faa900b3e10 0x7faa9015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa900b4900 con 0x7faa901461f0 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7faa80001670 con 0x7faa901461f0 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 >> v1:172.21.15.114:6789/0 conn(0x7faa901461f0 legacy=0x7faa900ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa7c0039b0 0x7faa7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 0x7faa7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa7c004d40 0x7faa7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa900b4620 con 0x7faa7c004d40 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c00b9c0 con 0x7faa7c0039b0 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faa7c00bb40 con 0x7faa900cefc0 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa948bb640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa7c004d40 0x7faa7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8ffff640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa7c0039b0 0x7faa7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa8f7fe640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 0x7faa7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa948bb640 1 -- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 msgr2=0x7faa7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa948bb640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa900cefc0 0x7faa7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa948bb640 1 -- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa7c0039b0 msgr2=0x7faa7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa948bb640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa7c0039b0 0x7faa7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.189+0000 7faa948bb640 1 -- 172.21.15.114:0/3636668456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c003520 con 0x7faa7c004d40 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.190+0000 7faa948bb640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa7c004d40 0x7faa7c0051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa88009fc0 tx=0x7faa7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd550c4481d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.190+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88039070 con 0x7faa7c004d40 2024-04-13T02:45:17.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.190+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8802cc60 con 0x7faa7c004d40 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.190+0000 7faa8effd640 1 -- 172.21.15.114:0/3636668456 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88009c10 con 0x7faa7c004d40 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa9631e640 1 -- 172.21.15.114:0/3636668456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa7c004d40 msgr2=0x7faa7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa9631e640 1 --2- 172.21.15.114:0/3636668456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa7c004d40 0x7faa7c0051c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa88009fc0 tx=0x7faa7c005830 comp rx=0 tx=0).stop 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa948bb640 1 -- 172.21.15.114:0/3636668456 reap_dead start 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa9631e640 1 -- 172.21.15.114:0/3636668456 shutdown_connections 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa9631e640 1 -- 172.21.15.114:0/3636668456 >> 172.21.15.114:0/3636668456 conn(0x7faa900b27b0 msgr2=0x7faa900b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa9631e640 1 -- 172.21.15.114:0/3636668456 shutdown_connections 2024-04-13T02:45:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.191+0000 7faa9631e640 1 -- 172.21.15.114:0/3636668456 wait complete. 2024-04-13T02:45:17.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.192+0000 7faa9631e640 1 Processor -- start 2024-04-13T02:45:17.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.192+0000 7faa9631e640 1 -- start start 2024-04-13T02:45:17.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa9631e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa7c004d40 0x7faa900ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa9631e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 0x7faa900cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa9631e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa9015c6d0 0x7faa900cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa9631e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faa901465d0 con 0x7faa9015c250 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa9631e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa9015d290 con 0x7faa9015c6d0 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa9631e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faa900b42a0 con 0x7faa7c004d40 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 0x7faa900cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 0x7faa900cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34620/0 (socket says 172.21.15.114:34620) 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 -- 172.21.15.114:0/4034610863 learned_addr learned my addr 172.21.15.114:0/4034610863 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa948bb640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa9015c6d0 0x7faa900cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8ffff640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa7c004d40 0x7faa900ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 -- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa7c004d40 msgr2=0x7faa900ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa7c004d40 0x7faa900ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 -- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa9015c6d0 msgr2=0x7faa900cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa9015c6d0 0x7faa900cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 -- 172.21.15.114:0/4034610863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa901379e0 con 0x7faa9015c250 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.193+0000 7faa8f7fe640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 0x7faa900cd420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faa780119a0 tx=0x7faa78011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.194+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7800faf0 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.194+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7800fc90 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.194+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa90137cc0 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.194+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78014440 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.194+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa90138280 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.195+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa900c6e80 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.195+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa78012040 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.195+0000 7faa8cff9640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faa7006c8f0 0x7faa7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.195+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa7808c270 con 0x7faa9015c250 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.195+0000 7faa8ffff640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faa7006c8f0 0x7faa7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.196+0000 7faa8ffff640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faa7006c8f0 0x7faa7006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faa90070420 tx=0x7faa80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.200+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa900c6e80 con 0x7faa9015c250 2024-04-13T02:45:17.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.414+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa900cfa40 con 0x7faa9015c250 2024-04-13T02:45:17.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.414+0000 7faa8cff9640 1 -- 172.21.15.114:0/4034610863 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7faa900cfa40 con 0x7faa9015c250 2024-04-13T02:45:17.415 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:17.415 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:45:17.415 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:45:17.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faa7006c8f0 msgr2=0x7faa7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faa7006c8f0 0x7faa7006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faa90070420 tx=0x7faa80009040 comp rx=0 tx=0).stop 2024-04-13T02:45:17.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 msgr2=0x7faa900cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 0x7faa900cd420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faa780119a0 tx=0x7faa78011e60 comp rx=0 tx=0).stop 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 shutdown_connections 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa9015c6d0 0x7faa900cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa9015c250 0x7faa900cd420 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faa7006c8f0 0x7faa7006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 --2- 172.21.15.114:0/4034610863 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa7c004d40 0x7faa900ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.416+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 >> 172.21.15.114:0/4034610863 conn(0x7faa900b27b0 msgr2=0x7faa9015f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.417+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 shutdown_connections 2024-04-13T02:45:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.417+0000 7faa9631e640 1 -- 172.21.15.114:0/4034610863 wait complete. 2024-04-13T02:45:17.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:17.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.529+0000 7ff9e70b0640 1 Processor -- start 2024-04-13T02:45:17.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.529+0000 7ff9e70b0640 1 -- start start 2024-04-13T02:45:17.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e70b0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9e015edb0 0x7ff9e009ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e70b0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e00b3ec0 0x7ff9e009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e70b0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9e006d450 0x7ff9e00c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e70b0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e00cce20 con 0x7ff9e015edb0 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e70b0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e006cd90 con 0x7ff9e006d450 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e70b0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e006d070 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9e015edb0 0x7ff9e009ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9e015edb0 0x7ff9e009ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34626/0 (socket says 172.21.15.114:34626) 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 -- 172.21.15.114:0/395881320 learned_addr learned my addr 172.21.15.114:0/395881320 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e564d640 1 --2- 172.21.15.114:0/395881320 >> v2:172.21.15.130:3300/0 conn(0x7ff9e006d450 0x7ff9e00c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9dffff640 1 --2- 172.21.15.114:0/395881320 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e00b3ec0 0x7ff9e009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 -- 172.21.15.114:0/395881320 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e00b3ec0 msgr2=0x7ff9e009b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 --2- 172.21.15.114:0/395881320 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e00b3ec0 0x7ff9e009b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 -- 172.21.15.114:0/395881320 >> v2:172.21.15.130:3300/0 conn(0x7ff9e006d450 msgr2=0x7ff9e00c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 --2- 172.21.15.114:0/395881320 >> v2:172.21.15.130:3300/0 conn(0x7ff9e006d450 0x7ff9e00c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.530+0000 7ff9e4e4c640 1 -- 172.21.15.114:0/395881320 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00cd070 con 0x7ff9e015edb0 2024-04-13T02:45:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.531+0000 7ff9e4e4c640 1 --2- 172.21.15.114:0/395881320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e015edb0 0x7ff9e009ab90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00733b0 tx=0x7ff9d002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffe279c2dbfacee server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.531+0000 7ff9df7fe640 1 -- 172.21.15.114:0/395881320 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d002e070 con 0x7ff9e015edb0 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.531+0000 7ff9df7fe640 1 -- 172.21.15.114:0/395881320 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0037070 con 0x7ff9e015edb0 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.531+0000 7ff9df7fe640 1 -- 172.21.15.114:0/395881320 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0031a00 con 0x7ff9e015edb0 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 -- 172.21.15.114:0/395881320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e015edb0 msgr2=0x7ff9e009ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/395881320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e015edb0 0x7ff9e009ab90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00733b0 tx=0x7ff9d002b880 comp rx=0 tx=0).stop 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 -- 172.21.15.114:0/395881320 shutdown_connections 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/395881320 >> v2:172.21.15.130:3300/0 conn(0x7ff9e006d450 0x7ff9e00c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/395881320 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e00b3ec0 0x7ff9e009b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/395881320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e015edb0 0x7ff9e009ab90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 -- 172.21.15.114:0/395881320 >> 172.21.15.114:0/395881320 conn(0x7ff9e00d27d0 msgr2=0x7ff9e00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 -- 172.21.15.114:0/395881320 shutdown_connections 2024-04-13T02:45:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.532+0000 7ff9e70b0640 1 -- 172.21.15.114:0/395881320 wait complete. 2024-04-13T02:45:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.533+0000 7ff9e70b0640 1 Processor -- start 2024-04-13T02:45:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.533+0000 7ff9e70b0640 1 -- start start 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e70b0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e006d450 0x7ff9e01f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e70b0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 0x7ff9e015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e70b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e015edb0 0x7ff9e015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e70b0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00c8070 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e70b0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e006ca40 con 0x7ff9e015edb0 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e70b0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00c81f0 con 0x7ff9e006d450 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 0x7ff9e015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 0x7ff9e015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34632/0 (socket says 172.21.15.114:34632) 2024-04-13T02:45:17.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 -- 172.21.15.114:0/1655968761 learned_addr learned my addr 172.21.15.114:0/1655968761 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e4e4c640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e006d450 0x7ff9e01f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e564d640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e015edb0 0x7ff9e015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 -- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e006d450 msgr2=0x7ff9e01f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e006d450 0x7ff9e01f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 -- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e015edb0 msgr2=0x7ff9e015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e015edb0 0x7ff9e015a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9dffff640 1 -- 172.21.15.114:0/1655968761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00b56e0 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.534+0000 7ff9e564d640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e015edb0 0x7ff9e015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.535+0000 7ff9dffff640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 0x7ff9e015a010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400d800 tx=0x7ff9d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.535+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400b6c0 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.535+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4019070 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.535+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e00b59c0 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.535+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400ba80 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.535+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e01f5550 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.536+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0068c80 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.536+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9d400bc20 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.537+0000 7ff9dd7fa640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff9cc06c8f0 0x7ff9cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.537+0000 7ff9e4e4c640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff9cc06c8f0 0x7ff9cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.537+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff9d408bf40 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.537+0000 7ff9e4e4c640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff9cc06c8f0 0x7ff9cc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0036000 tx=0x7ff9d003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.541+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9d405a370 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.750+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e00d2f30 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.751+0000 7ff9dd7fa640 1 -- 172.21.15.114:0/1655968761 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5187 (secure 0 0 0) 0x7ff9d4060030 con 0x7ff9e00b3ec0 2024-04-13T02:45:17.752 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:17.752 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4151285677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4151285677},{"type":"v1","addr":"172.21.15.130:6834","nonce":4151285677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1232413081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1232413081},{"type":"v1","addr":"172.21.15.114:6835","nonce":1232413081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4013055954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":4013055954},{"type":"v1","addr":"172.21.15.114:6837","nonce":4013055954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:44:39.559594+0000","modified":"2024-04-13T02:44:41.561259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/3235541552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3235541552},{"type":"v1","addr":"172.21.15.130:6835","nonce":3235541552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-04-13T02:45:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 6 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff9cc06c8f0 msgr2=0x7ff9cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff9cc06c8f0 0x7ff9cc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0036000 tx=0x7ff9d003d040 comp rx=0 tx=0).stop 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 msgr2=0x7ff9e015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 0x7ff9e015a010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400d800 tx=0x7ff9d400dcc0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 shutdown_connections 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e015edb0 0x7ff9e015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9e00b3ec0 0x7ff9e015a010 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff9cc06c8f0 0x7ff9cc06edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 --2- 172.21.15.114:0/1655968761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9e006d450 0x7ff9e01f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 >> 172.21.15.114:0/1655968761 conn(0x7ff9e00d27d0 msgr2=0x7ff9e00d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 shutdown_connections 2024-04-13T02:45:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.753+0000 7ff9e70b0640 1 -- 172.21.15.114:0/1655968761 wait complete. 2024-04-13T02:45:17.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.864+0000 7febc0688640 1 Processor -- start 2024-04-13T02:45:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.864+0000 7febc0688640 1 -- start start 2024-04-13T02:45:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febc0688640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7febb80d3e20 0x7febb80d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febc0688640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7febb815ee00 0x7febb80cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febc0688640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febc0688640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7febb80cfba0 con 0x7febb815ee00 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febc0688640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7febb80d2b10 con 0x7febb80d3e20 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febc0688640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7febb80d33b0 con 0x7febb80cf6f0 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febbdc23640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7febb815ee00 0x7febb80cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febbdc23640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7febb815ee00 0x7febb80cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34646/0 (socket says 172.21.15.114:34646) 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.865+0000 7febbdc23640 1 -- 172.21.15.114:0/3595096216 learned_addr learned my addr 172.21.15.114:0/3595096216 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbe424640 1 --2- 172.21.15.114:0/3595096216 >> v2:172.21.15.130:3300/0 conn(0x7febb80d3e20 0x7febb80d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbec25640 1 --2- 172.21.15.114:0/3595096216 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbdc23640 1 -- 172.21.15.114:0/3595096216 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 msgr2=0x7febb80b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbdc23640 1 --2- 172.21.15.114:0/3595096216 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbdc23640 1 -- 172.21.15.114:0/3595096216 >> v2:172.21.15.130:3300/0 conn(0x7febb80d3e20 msgr2=0x7febb80d4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbdc23640 1 --2- 172.21.15.114:0/3595096216 >> v2:172.21.15.130:3300/0 conn(0x7febb80d3e20 0x7febb80d4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbdc23640 1 -- 172.21.15.114:0/3595096216 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb80d4740 con 0x7febb815ee00 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.866+0000 7febbdc23640 1 --2- 172.21.15.114:0/3595096216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb80cf1b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febb808d180 tx=0x7feba802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82a4d0bc1a9e182 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febbd422640 1 -- 172.21.15.114:0/3595096216 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8034070 con 0x7febb815ee00 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febbd422640 1 -- 172.21.15.114:0/3595096216 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba8030860 con 0x7febb815ee00 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febbd422640 1 -- 172.21.15.114:0/3595096216 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8030c30 con 0x7febb815ee00 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 -- 172.21.15.114:0/3595096216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 msgr2=0x7febb80cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 --2- 172.21.15.114:0/3595096216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb80cf1b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febb808d180 tx=0x7feba802b9a0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 -- 172.21.15.114:0/3595096216 shutdown_connections 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 --2- 172.21.15.114:0/3595096216 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 --2- 172.21.15.114:0/3595096216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb80cf1b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 --2- 172.21.15.114:0/3595096216 >> v2:172.21.15.130:3300/0 conn(0x7febb80d3e20 0x7febb80d4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 -- 172.21.15.114:0/3595096216 >> 172.21.15.114:0/3595096216 conn(0x7febb806d470 msgr2=0x7febb806d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 -- 172.21.15.114:0/3595096216 shutdown_connections 2024-04-13T02:45:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.867+0000 7febc0688640 1 -- 172.21.15.114:0/3595096216 wait complete. 2024-04-13T02:45:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.868+0000 7febc0688640 1 Processor -- start 2024-04-13T02:45:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.868+0000 7febc0688640 1 -- start start 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febc0688640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febc0688640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80d3e20 0x7febb8151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febc0688640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb81f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febc0688640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7febb80d3040 con 0x7febb815ee00 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febc0688640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febb80d2d60 con 0x7febb80d3e20 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febc0688640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7febb80d3840 con 0x7febb80cf6f0 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb81f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb81f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34658/0 (socket says 172.21.15.114:34658) 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 -- 172.21.15.114:0/1171583131 learned_addr learned my addr 172.21.15.114:0/1171583131 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbe424640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbdc23640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80d3e20 0x7febb8151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 -- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 msgr2=0x7febb80cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 -- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80d3e20 msgr2=0x7febb8151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80d3e20 0x7febb8151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.869+0000 7febbec25640 1 -- 172.21.15.114:0/1171583131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb80b52f0 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.870+0000 7febbec25640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb81f4900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7febb000d830 tx=0x7febb000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.870+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0018020 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.870+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb00096c0 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.870+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb80b55d0 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.870+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0009a90 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.870+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb80b5e70 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.871+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb80b59c0 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.871+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7febb001b020 con 0x7febb815ee00 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.872+0000 7febaeffd640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb9c06c8f0 0x7feb9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.872+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7febb008c050 con 0x7febb815ee00 2024-04-13T02:45:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.872+0000 7febbe424640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb9c06c8f0 0x7feb9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.872+0000 7febbe424640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb9c06c8f0 0x7feb9c06edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7febb4009a60 tx=0x7febb4003990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:17.876+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febb0022030 con 0x7febb815ee00 2024-04-13T02:45:18.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.050+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febb8068c80 con 0x7febb815ee00 2024-04-13T02:45:18.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.051+0000 7febaeffd640 1 -- 172.21.15.114:0/1171583131 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7febb00102e0 con 0x7febb815ee00 2024-04-13T02:45:18.052 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:18.052 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:44:41.217549+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:44:37.527771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-13T02:44:38.517825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb9c06c8f0 msgr2=0x7feb9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb9c06c8f0 0x7feb9c06edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7febb4009a60 tx=0x7febb4003990 comp rx=0 tx=0).stop 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 msgr2=0x7febb81f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb81f4900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7febb000d830 tx=0x7febb000dcf0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 shutdown_connections 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febb815ee00 0x7febb81f4900 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb80d3e20 0x7febb8151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7feb9c06c8f0 0x7feb9c06edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 --2- 172.21.15.114:0/1171583131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7febb80cf6f0 0x7febb80cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 >> 172.21.15.114:0/1171583131 conn(0x7febb806d470 msgr2=0x7febb80cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 shutdown_connections 2024-04-13T02:45:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.053+0000 7febc0688640 1 -- 172.21.15.114:0/1171583131 wait complete. 2024-04-13T02:45:18.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-13T02:45:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.166+0000 7fdd84a2d640 1 Processor -- start 2024-04-13T02:45:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.167+0000 7fdd84a2d640 1 -- start start 2024-04-13T02:45:18.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.167+0000 7fdd84a2d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.167+0000 7fdd84a2d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 0x7fdd800d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.167+0000 7fdd84a2d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd800d32c0 con 0x7fdd800d2c30 2024-04-13T02:45:18.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.167+0000 7fdd84a2d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdd800d3090 con 0x7fdd800d1300 2024-04-13T02:45:18.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.167+0000 7fdd84a2d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800d35a0 con 0x7fdd8015ec40 2024-04-13T02:45:18.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 0x7fdd800d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7ed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 0x7fdd800d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:40098/0 (socket says 172.21.15.114:40098) 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800d4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:59146/0 (socket says 172.21.15.114:59146) 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd77fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fdd800d2c30 0x7fdd800ba390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:56434/0 (socket says 172.21.15.114:56434) 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7ed9d640 1 -- 172.21.15.114:0/760271081 learned_addr learned my addr 172.21.15.114:0/760271081 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7e59c640 1 -- 172.21.15.114:0/760271081 >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 msgr2=0x7fdd800d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7e59c640 1 --2- 172.21.15.114:0/760271081 >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 0x7fdd800d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7e59c640 1 -- 172.21.15.114:0/760271081 >> v1:172.21.15.130:6789/0 conn(0x7fdd800d2c30 legacy=0x7fdd800ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7e59c640 1 -- 172.21.15.114:0/760271081 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd800d3880 con 0x7fdd8015ec40 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7dd9b640 1 -- 172.21.15.114:0/760271081 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837786401 0 0) 0x7fdd800d32c0 con 0x7fdd800d2c30 2024-04-13T02:45:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.168+0000 7fdd7ed9d640 1 --2- 172.21.15.114:0/760271081 >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 0x7fdd800d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:18.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.169+0000 7fdd7e59c640 1 --2- 172.21.15.114:0/760271081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800d4360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd700097a0 tx=0x7fdd7002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=734985bf72b3665b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:18.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.169+0000 7fdd7dd9b640 1 -- 172.21.15.114:0/760271081 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70035020 con 0x7fdd8015ec40 2024-04-13T02:45:18.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.169+0000 7fdd7dd9b640 1 -- 172.21.15.114:0/760271081 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd70031830 con 0x7fdd8015ec40 2024-04-13T02:45:18.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.169+0000 7fdd7dd9b640 1 -- 172.21.15.114:0/760271081 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70031c00 con 0x7fdd8015ec40 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 -- 172.21.15.114:0/760271081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 msgr2=0x7fdd800d4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/760271081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800d4360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd700097a0 tx=0x7fdd7002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 -- 172.21.15.114:0/760271081 shutdown_connections 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/760271081 >> v2:172.21.15.130:3300/0 conn(0x7fdd800d1300 0x7fdd800d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/760271081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800d4360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 -- 172.21.15.114:0/760271081 >> 172.21.15.114:0/760271081 conn(0x7fdd80073690 msgr2=0x7fdd8006cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 -- 172.21.15.114:0/760271081 shutdown_connections 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.170+0000 7fdd84a2d640 1 -- 172.21.15.114:0/760271081 wait complete. 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.171+0000 7fdd84a2d640 1 Processor -- start 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.171+0000 7fdd84a2d640 1 -- start start 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 0x7fdd8014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd800d2c30 0x7fdd800b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800b78f0 con 0x7fdd800d1300 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800d3e40 con 0x7fdd800d2c30 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800b7a70 con 0x7fdd8015ec40 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 0x7fdd8014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 0x7fdd8014aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34664/0 (socket says 172.21.15.114:34664) 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 -- 172.21.15.114:0/2918357024 learned_addr learned my addr 172.21.15.114:0/2918357024 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd77fff640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd800d2c30 0x7fdd800b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7ed9d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 -- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 msgr2=0x7fdd800cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 -- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd800d2c30 msgr2=0x7fdd800b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd800d2c30 0x7fdd800b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 -- 172.21.15.114:0/2918357024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd800b6760 con 0x7fdd800d1300 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd7e59c640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 0x7fdd8014aec0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdd700097a0 tx=0x7fdd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70035040 con 0x7fdd800d1300 2024-04-13T02:45:18.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd70004230 con 0x7fdd800d1300 2024-04-13T02:45:18.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd800b6a40 con 0x7fdd800d1300 2024-04-13T02:45:18.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7003a640 con 0x7fdd800d1300 2024-04-13T02:45:18.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.172+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd80160160 con 0x7fdd800d1300 2024-04-13T02:45:18.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.173+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd80068c80 con 0x7fdd800d1300 2024-04-13T02:45:18.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.174+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd70038020 con 0x7fdd800d1300 2024-04-13T02:45:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.174+0000 7fdd76ffd640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd6006c8f0 0x7fdd6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.174+0000 7fdd77fff640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd6006c8f0 0x7fdd6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.174+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdd700ad800 con 0x7fdd800d1300 2024-04-13T02:45:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.175+0000 7fdd77fff640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd6006c8f0 0x7fdd6006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd801f7d30 tx=0x7fdd68007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.179+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd7007bcc0 con 0x7fdd800d1300 2024-04-13T02:45:18.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.391+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdd800cb060 con 0x7fdd800d1300 2024-04-13T02:45:18.392 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-04-13T02:45:18.392+0000 7fd07ee8a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T02:45:18.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.393+0000 7fdd76ffd640 1 -- 172.21.15.114:0/2918357024 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fdd7007b5c0 con 0x7fdd800d1300 2024-04-13T02:45:18.394 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-13T02:45:18.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd6006c8f0 msgr2=0x7fdd6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd6006c8f0 0x7fdd6006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd801f7d30 tx=0x7fdd68007b50 comp rx=0 tx=0).stop 2024-04-13T02:45:18.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 msgr2=0x7fdd8014aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 0x7fdd8014aec0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdd700097a0 tx=0x7fdd700046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 shutdown_connections 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd6006c8f0 0x7fdd6006edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd8015ec40 0x7fdd800cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd800d2c30 0x7fdd800b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 --2- 172.21.15.114:0/2918357024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd800d1300 0x7fdd8014aec0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 >> 172.21.15.114:0/2918357024 conn(0x7fdd80073690 msgr2=0x7fdd800c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 shutdown_connections 2024-04-13T02:45:18.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.396+0000 7fdd84a2d640 1 -- 172.21.15.114:0/2918357024 wait complete. 2024-04-13T02:45:18.402 INFO:tasks.ceph.mds.d.smithi130.stderr: -7347> 2024-04-13T02:44:44.102+0000 7fce9f9f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:45:18.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-13T02:45:18.433 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-04-13T02:45:18.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.510+0000 7fa3c0d5e640 1 Processor -- start 2024-04-13T02:45:18.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.510+0000 7fa3c0d5e640 1 -- start start 2024-04-13T02:45:18.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.510+0000 7fa3c0d5e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa3bc15ebb0 0x7fa3bc0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3c0d5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3bc0b7950 0x7fa3bc06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3c0d5e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3bc0b68b0 con 0x7fa3bc09ac00 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3c0d5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa3bc0b6b90 con 0x7fa3bc0b7950 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3c0d5e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa3bc0b6e70 con 0x7fa3bc15ebb0 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3bc0b7950 0x7fa3bc06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3bc0b7950 0x7fa3bc06dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34678/0 (socket says 172.21.15.114:34678) 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 -- 172.21.15.114:0/1366861291 learned_addr learned my addr 172.21.15.114:0/1366861291 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3ba59c640 1 --2- 172.21.15.114:0/1366861291 >> v2:172.21.15.130:3300/0 conn(0x7fa3bc15ebb0 0x7fa3bc0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 -- 172.21.15.114:0/1366861291 >> v2:172.21.15.130:3300/0 conn(0x7fa3bc15ebb0 msgr2=0x7fa3bc0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 --2- 172.21.15.114:0/1366861291 >> v2:172.21.15.130:3300/0 conn(0x7fa3bc15ebb0 0x7fa3bc0b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 -- 172.21.15.114:0/1366861291 >> v1:172.21.15.130:6789/0 conn(0x7fa3bc09ac00 legacy=0x7fa3bc0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.511+0000 7fa3b3fff640 1 -- 172.21.15.114:0/1366861291 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc0b7150 con 0x7fa3bc0b7950 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3b3fff640 1 --2- 172.21.15.114:0/1366861291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc06dbb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0d3810 tx=0x7fa3a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b20595f05172897 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3b9d9b640 1 -- 172.21.15.114:0/1366861291 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4034070 con 0x7fa3bc0b7950 2024-04-13T02:45:18.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3b9d9b640 1 -- 172.21.15.114:0/1366861291 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a4030860 con 0x7fa3bc0b7950 2024-04-13T02:45:18.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3b9d9b640 1 -- 172.21.15.114:0/1366861291 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4030c30 con 0x7fa3bc0b7950 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/1366861291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc0b7950 msgr2=0x7fa3bc06dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/1366861291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc06dbb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0d3810 tx=0x7fa3a402b9a0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/1366861291 shutdown_connections 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/1366861291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc06dbb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/1366861291 >> v2:172.21.15.130:3300/0 conn(0x7fa3bc15ebb0 0x7fa3bc0b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/1366861291 >> 172.21.15.114:0/1366861291 conn(0x7fa3bc0b7eb0 msgr2=0x7fa3bc0b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.512+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/1366861291 shutdown_connections 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.513+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/1366861291 wait complete. 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.514+0000 7fa3c0d5e640 1 Processor -- start 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.514+0000 7fa3c0d5e640 1 -- start start 2024-04-13T02:45:18.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.514+0000 7fa3c0d5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 0x7fa3bc1f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.514+0000 7fa3c0d5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3c0d5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3bc15ebb0 0x7fa3bc0d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3c0d5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc15ef90 con 0x7fa3bc09ac00 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3c0d5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc06e0f0 con 0x7fa3bc0b7950 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3c0d5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc09b050 con 0x7fa3bc15ebb0 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 0x7fa3bc1f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 0x7fa3bc1f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34688/0 (socket says 172.21.15.114:34688) 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 -- 172.21.15.114:0/3726093934 learned_addr learned my addr 172.21.15.114:0/3726093934 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3bad9d640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3bc15ebb0 0x7fa3bc0d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3b3fff640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 -- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3bc15ebb0 msgr2=0x7fa3bc0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3bc15ebb0 0x7fa3bc0d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 -- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3bc0b7950 msgr2=0x7fa3bc0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:18.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 -- 172.21.15.114:0/3726093934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc15d590 con 0x7fa3bc09ac00 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3b3fff640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3bad9d640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3bc15ebb0 0x7fa3bc0d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3ba59c640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 0x7fa3bc1f8d10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00d620 tx=0x7fa3ac00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00b620 con 0x7fa3bc09ac00 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac019070 con 0x7fa3bc09ac00 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc1f8270 con 0x7fa3bc09ac00 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00ba00 con 0x7fa3bc09ac00 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.515+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc1f8510 con 0x7fa3bc09ac00 2024-04-13T02:45:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.516+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc068c80 con 0x7fa3bc09ac00 2024-04-13T02:45:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.517+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3ac00bba0 con 0x7fa3bc09ac00 2024-04-13T02:45:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.517+0000 7fa3b2ffd640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa39c06c8f0 0x7fa39c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.517+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7fa3ac08bf10 con 0x7fa3bc09ac00 2024-04-13T02:45:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.517+0000 7fa3b3fff640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa39c06c8f0 0x7fa39c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.518+0000 7fa3b3fff640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa39c06c8f0 0x7fa39c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4036000 tx=0x7fa3a403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.521+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3ac05a370 con 0x7fa3bc09ac00 2024-04-13T02:45:18.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:18.733+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa3bc0ceee0 con 0x7fa3bc09ac00 2024-04-13T02:45:19.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.394+0000 7fa3b2ffd640 1 -- 172.21.15.114:0/3726093934 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7fa3ac060070 con 0x7fa3bc09ac00 2024-04-13T02:45:19.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa39c06c8f0 msgr2=0x7fa39c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa39c06c8f0 0x7fa39c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4036000 tx=0x7fa3a403b040 comp rx=0 tx=0).stop 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 msgr2=0x7fa3bc1f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 0x7fa3bc1f8d10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00d620 tx=0x7fa3ac00dae0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 shutdown_connections 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa39c06c8f0 0x7fa39c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa3bc15ebb0 0x7fa3bc0d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa3bc0b7950 0x7fa3bc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 --2- 172.21.15.114:0/3726093934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3bc09ac00 0x7fa3bc1f8d10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 >> 172.21.15.114:0/3726093934 conn(0x7fa3bc0b7eb0 msgr2=0x7fa3bc15d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 shutdown_connections 2024-04-13T02:45:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.397+0000 7fa3c0d5e640 1 -- 172.21.15.114:0/3726093934 wait complete. 2024-04-13T02:45:19.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-13T02:45:19.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.522+0000 7fc1a52c8640 1 Processor -- start 2024-04-13T02:45:19.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.522+0000 7fc1a52c8640 1 -- start start 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc1a52c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc1a00b76a0 0x7fc1a0163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc1a52c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a00b6600 con 0x7fc1a009b2a0 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc1a52c8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a00b68e0 con 0x7fc1a015eb90 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc1a52c8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a009bd30 con 0x7fc1a00b76a0 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc19e7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc1a009b2a0 0x7fc1a00cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41424/0 (socket says 172.21.15.114:41424) 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc19e7fc640 1 -- 172.21.15.114:0/2684899486 learned_addr learned my addr 172.21.15.114:0/2684899486 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc19f7fe640 1 --2- 172.21.15.114:0/2684899486 >> v2:172.21.15.130:3300/0 conn(0x7fc1a00b76a0 0x7fc1a0163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600769746 0 0) 0x7fc1a00b6600 con 0x7fc1a009b2a0 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.523+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc188003520 con 0x7fc1a009b2a0 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4289337182 0 0) 0x7fc188003520 con 0x7fc1a009b2a0 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 >> v2:172.21.15.130:3300/0 conn(0x7fc1a00b76a0 msgr2=0x7fc1a0163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:19.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 --2- 172.21.15.114:0/2684899486 >> v2:172.21.15.130:3300/0 conn(0x7fc1a00b76a0 0x7fc1a0163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 >> v1:172.21.15.130:6789/0 conn(0x7fc1a015eb90 legacy=0x7fc1a009ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a00b6bc0 con 0x7fc1a009b2a0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fc194001670 con 0x7fc1a009b2a0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 >> v1:172.21.15.114:6789/0 conn(0x7fc1a009b2a0 legacy=0x7fc1a00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1880039b0 0x7fc188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc188004800 0x7fc188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1880051c0 0x7fc18800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc18800c030 con 0x7fc188004800 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc18800c1e0 con 0x7fc1880039b0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc18800c3e0 con 0x7fc1880051c0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19e7fc640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc188004800 0x7fc188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19f7fe640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1880051c0 0x7fc18800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19effd640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1880039b0 0x7fc188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19e7fc640 1 -- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1880051c0 msgr2=0x7fc18800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19e7fc640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1880051c0 0x7fc18800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19e7fc640 1 -- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1880039b0 msgr2=0x7fc188003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19e7fc640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1880039b0 0x7fc188003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19f7fe640 1 -- 172.21.15.114:0/2684899486 reap_dead start 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19e7fc640 1 -- 172.21.15.114:0/2684899486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc188003520 con 0x7fc188004800 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.524+0000 7fc19effd640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1880039b0 0x7fc188003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.525+0000 7fc19e7fc640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc188004800 0x7fc188004c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c210 tx=0x7fc188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b65038cfc068849 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.525+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194007d30 con 0x7fc188004800 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.525+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc194030070 con 0x7fc188004800 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.525+0000 7fc19dffb640 1 -- 172.21.15.114:0/2684899486 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194005d70 con 0x7fc188004800 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.525+0000 7fc1a52c8640 1 -- 172.21.15.114:0/2684899486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc188004800 msgr2=0x7fc188004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.525+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc188004800 0x7fc188004c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c210 tx=0x7fc188005830 comp rx=0 tx=0).stop 2024-04-13T02:45:19.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.526+0000 7fc1a52c8640 1 -- 172.21.15.114:0/2684899486 shutdown_connections 2024-04-13T02:45:19.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.526+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/2684899486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc188004800 0x7fc188004c80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.526+0000 7fc1a52c8640 1 -- 172.21.15.114:0/2684899486 >> 172.21.15.114:0/2684899486 conn(0x7fc1a00b4400 msgr2=0x7fc1a00b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:19.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.526+0000 7fc1a52c8640 1 -- 172.21.15.114:0/2684899486 shutdown_connections 2024-04-13T02:45:19.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.526+0000 7fc1a52c8640 1 -- 172.21.15.114:0/2684899486 wait complete. 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.527+0000 7fc1a52c8640 1 Processor -- start 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.527+0000 7fc1a52c8640 1 -- start start 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc188004800 0x7fc1a0145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1a01e90a0 0x7fc1a01e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 0x7fc1a015fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a015ef70 con 0x7fc1a01e9a60 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a00b7180 con 0x7fc1a01e90a0 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a00b6060 con 0x7fc188004800 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 0x7fc1a015fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 0x7fc1a015fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59088/0 (socket says 172.21.15.114:59088) 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 -- 172.21.15.114:0/1817263521 learned_addr learned my addr 172.21.15.114:0/1817263521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:19.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19effd640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc188004800 0x7fc1a0145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19e7fc640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1a01e90a0 0x7fc1a01e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 -- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc188004800 msgr2=0x7fc1a0145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc188004800 0x7fc1a0145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 -- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1a01e90a0 msgr2=0x7fc1a01e9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1a01e90a0 0x7fc1a01e9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 -- 172.21.15.114:0/1817263521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a01e9ee0 con 0x7fc1a01e9a60 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc19f7fe640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 0x7fc1a015fd00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc1a006ec10 tx=0x7fc19800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19800fce0 con 0x7fc1a01e9a60 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19800fe80 con 0x7fc1a01e9a60 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198015670 con 0x7fc1a01e9a60 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a00ce210 con 0x7fc1a01e9a60 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.528+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a015f500 con 0x7fc1a01e9a60 2024-04-13T02:45:19.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.529+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a0068db0 con 0x7fc1a01e9a60 2024-04-13T02:45:19.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.530+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc198015810 con 0x7fc1a01e9a60 2024-04-13T02:45:19.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.530+0000 7fc1877fe640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc18c06c8f0 0x7fc18c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:19.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.530+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7fc19808ca70 con 0x7fc1a01e9a60 2024-04-13T02:45:19.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.530+0000 7fc19effd640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc18c06c8f0 0x7fc18c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:19.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.531+0000 7fc19effd640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc18c06c8f0 0x7fc18c06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc190000c00 tx=0x7fc190009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:19.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.534+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc198019030 con 0x7fc1a01e9a60 2024-04-13T02:45:19.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:19.711+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc1a009b7c0 con 0x7fc1a01e9a60 2024-04-13T02:45:20.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.398+0000 7fc1877fe640 1 -- 172.21.15.114:0/1817263521 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7fc198010040 con 0x7fc1a01e9a60 2024-04-13T02:45:20.400 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-04-13T02:45:20.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc18c06c8f0 msgr2=0x7fc18c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:20.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc18c06c8f0 0x7fc18c06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc190000c00 tx=0x7fc190009040 comp rx=0 tx=0).stop 2024-04-13T02:45:20.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 msgr2=0x7fc1a015fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:20.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 0x7fc1a015fd00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc1a006ec10 tx=0x7fc19800f1b0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 shutdown_connections 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1a01e9a60 0x7fc1a015fd00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc1a01e90a0 0x7fc1a01e9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc18c06c8f0 0x7fc18c06edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 --2- 172.21.15.114:0/1817263521 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc188004800 0x7fc1a0145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.401+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 >> 172.21.15.114:0/1817263521 conn(0x7fc1a00b4400 msgr2=0x7fc1a006cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.402+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 shutdown_connections 2024-04-13T02:45:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.402+0000 7fc1a52c8640 1 -- 172.21.15.114:0/1817263521 wait complete. 2024-04-13T02:45:20.420 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-13T02:45:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.524+0000 7f87e4fe0640 1 Processor -- start 2024-04-13T02:45:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.524+0000 7f87e4fe0640 1 -- start start 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.525+0000 7f87e4fe0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e0163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.525+0000 7f87e4fe0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87e00b76a0 0x7f87e00cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.525+0000 7f87e4fe0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e00b6600 con 0x7f87e015eb90 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.525+0000 7f87e4fe0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f87e009bd30 con 0x7f87e00b76a0 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.525+0000 7f87e4fe0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f87e0163670 con 0x7f87e009b2a0 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.525+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e0163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87ded9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f87e00b76a0 0x7f87e00cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87de59c640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f87e015eb90 0x7f87e009ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:52160/0 (socket says 172.21.15.114:52160) 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87de59c640 1 -- 172.21.15.114:0/1719712121 learned_addr learned my addr 172.21.15.114:0/1719712121 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e0163130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:45264/0 (socket says 172.21.15.114:45264) 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1719712121 >> v2:172.21.15.130:3300/0 conn(0x7f87e00b76a0 msgr2=0x7f87e00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87ddd9b640 1 --2- 172.21.15.114:0/1719712121 >> v2:172.21.15.130:3300/0 conn(0x7f87e00b76a0 0x7f87e00cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1719712121 >> v1:172.21.15.130:6789/0 conn(0x7f87e015eb90 legacy=0x7f87e009ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.526+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1719712121 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e00b68e0 con 0x7f87e009b2a0 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87ddd9b640 1 --2- 172.21.15.114:0/1719712121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e0163130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f87d40097a0 tx=0x7f87d402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2387bed8bbe9f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87dd59a640 1 -- 172.21.15.114:0/1719712121 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4035020 con 0x7f87e009b2a0 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87dd59a640 1 -- 172.21.15.114:0/1719712121 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d4031830 con 0x7f87e009b2a0 2024-04-13T02:45:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87dd59a640 1 -- 172.21.15.114:0/1719712121 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4031c00 con 0x7f87e009b2a0 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1719712121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 msgr2=0x7f87e0163130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1719712121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e0163130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f87d40097a0 tx=0x7f87d402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1719712121 shutdown_connections 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1719712121 >> v2:172.21.15.130:3300/0 conn(0x7f87e00b76a0 0x7f87e00cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1719712121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e0163130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1719712121 >> 172.21.15.114:0/1719712121 conn(0x7f87e00b4400 msgr2=0x7f87e00b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.527+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1719712121 shutdown_connections 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.528+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1719712121 wait complete. 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.529+0000 7f87e4fe0640 1 Processor -- start 2024-04-13T02:45:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.529+0000 7f87e4fe0640 1 -- start start 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.529+0000 7f87e4fe0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e00d0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 0x7f87e0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87e015eb90 0x7f87e0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f87e00b7180 con 0x7f87e00b76a0 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87e00b6ea0 con 0x7f87e015eb90 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f87e015ef70 con 0x7f87e009b2a0 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 0x7f87e0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 0x7f87e0153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59098/0 (socket says 172.21.15.114:59098) 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1486991674 learned_addr learned my addr 172.21.15.114:0/1486991674 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ded9d640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87e015eb90 0x7f87e0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87de59c640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e00d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 msgr2=0x7f87e00d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e00d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87e015eb90 msgr2=0x7f87e0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87e015eb90 0x7f87e0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 -- 172.21.15.114:0/1486991674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e00cf300 con 0x7f87e00b76a0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ddd9b640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 0x7f87e0153640 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f87d402bee0 tx=0x7f87d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4035040 con 0x7f87e00b76a0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d403b920 con 0x7f87e00b76a0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e0071750 con 0x7f87e00b76a0 2024-04-13T02:45:20.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d403bd10 con 0x7f87e00b76a0 2024-04-13T02:45:20.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.530+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e00cf880 con 0x7f87e00b76a0 2024-04-13T02:45:20.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.531+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e00b3b20 con 0x7f87e00b76a0 2024-04-13T02:45:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.532+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87d4038020 con 0x7f87e00b76a0 2024-04-13T02:45:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.532+0000 7f87ceffd640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f87c006c8f0 0x7f87c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.532+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5473+0+0 (secure 0 0 0) 0x7f87d40adaf0 con 0x7f87e00b76a0 2024-04-13T02:45:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.532+0000 7f87de59c640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f87c006c8f0 0x7f87c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.533+0000 7f87de59c640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f87c006c8f0 0x7f87c006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f87d80012e0 tx=0x7f87d8001990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.537+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87e00b3b20 con 0x7f87e00b76a0 2024-04-13T02:45:20.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:20.716+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f87e0068db0 con 0x7f87e00b76a0 2024-04-13T02:45:21.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.404+0000 7f87ceffd640 1 -- 172.21.15.114:0/1486991674 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f87d4031800 con 0x7f87e00b76a0 2024-04-13T02:45:21.405 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-04-13T02:45:21.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f87c006c8f0 msgr2=0x7f87c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:21.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f87c006c8f0 0x7f87c006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f87d80012e0 tx=0x7f87d8001990 comp rx=0 tx=0).stop 2024-04-13T02:45:21.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 msgr2=0x7f87e0153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:21.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 0x7f87e0153640 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f87d402bee0 tx=0x7f87d40046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 shutdown_connections 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87e015eb90 0x7f87e0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87e00b76a0 0x7f87e0153640 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f87c006c8f0 0x7f87c006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 --2- 172.21.15.114:0/1486991674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f87e009b2a0 0x7f87e00d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 >> 172.21.15.114:0/1486991674 conn(0x7f87e00b4400 msgr2=0x7f87e00b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 shutdown_connections 2024-04-13T02:45:21.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.406+0000 7f87e4fe0640 1 -- 172.21.15.114:0/1486991674 wait complete. 2024-04-13T02:45:21.423 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-13T02:45:21.423 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-13T02:45:21.424 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-13T02:45:21.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:45:21.424 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-13T02:45:21.424 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-13T02:45:21.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-13T02:45:21.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:45:21.425 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-13T02:45:21.425 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-13T02:45:21.425 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-13T02:45:21.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:45:21.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-13T02:45:21.426 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-13T02:45:21.426 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-13T02:45:21.426 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:45:21.434 INFO:tasks.ceph.mds.a:Stopped 2024-04-13T02:45:21.434 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-13T02:45:21.435 INFO:tasks.ceph.mds.c:Stopped 2024-04-13T02:45:21.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-13T02:45:21.436 INFO:tasks.ceph.mds.b:Stopped 2024-04-13T02:45:21.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-13T02:45:21.438 INFO:tasks.ceph.mds.d:Stopped 2024-04-13T02:45:21.438 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-13T02:45:21.477 INFO:tasks.ceph.mds.a:Started 2024-04-13T02:45:21.477 DEBUG:teuthology.parallel:result is None 2024-04-13T02:45:21.478 INFO:tasks.ceph.mds.c:Started 2024-04-13T02:45:21.478 DEBUG:teuthology.parallel:result is None 2024-04-13T02:45:21.480 INFO:tasks.ceph.mds.b:Started 2024-04-13T02:45:21.480 DEBUG:teuthology.parallel:result is None 2024-04-13T02:45:21.481 INFO:tasks.ceph.mds.d:Started 2024-04-13T02:45:21.482 DEBUG:teuthology.parallel:result is None 2024-04-13T02:45:21.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-13T02:45:21.558 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-04-13T02:45:21.558 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-04-13T02:45:21.564 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-04-13T02:45:21.564 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-04-13T02:45:21.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.589+0000 7f7d3151e640 1 Processor -- start 2024-04-13T02:45:21.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.589+0000 7f7d3151e640 1 -- start start 2024-04-13T02:45:21.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d3151e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d2c0cebc0 0x7f7d2c1610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:21.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d3151e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c0b3df0 0x7f7d2c09ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:21.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d3151e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2c0b23a0 con 0x7f7d2c09b060 2024-04-13T02:45:21.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d3151e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7d2c0b2150 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d3151e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c0b2fb0 con 0x7f7d2c0b3df0 2024-04-13T02:45:21.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d2affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d2c0cebc0 0x7f7d2c1610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d2affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d2c0cebc0 0x7f7d2c1610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59152/0 (socket says 172.21.15.114:59152) 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d2affd640 1 -- 172.21.15.114:0/2276143774 learned_addr learned my addr 172.21.15.114:0/2276143774 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.590+0000 7f7d2b7fe640 1 --1- 172.21.15.114:0/2276143774 >> v1:172.21.15.114:6789/0 conn(0x7f7d2c09b060 0x7f7d2c0d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41436/0 (socket says 172.21.15.114:41436) 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d2a7fc640 1 --2- 172.21.15.114:0/2276143774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c0b3df0 0x7f7d2c09ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d2affd640 1 -- 172.21.15.114:0/2276143774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c0b3df0 msgr2=0x7f7d2c09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d2affd640 1 --2- 172.21.15.114:0/2276143774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c0b3df0 0x7f7d2c09ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d2affd640 1 -- 172.21.15.114:0/2276143774 >> v1:172.21.15.114:6789/0 conn(0x7f7d2c09b060 legacy=0x7f7d2c0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d2affd640 1 -- 172.21.15.114:0/2276143774 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c0b2680 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d29ffb640 1 -- 172.21.15.114:0/2276143774 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651842492 0 0) 0x7f7d2c0b23a0 con 0x7f7d2c09b060 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.591+0000 7f7d2affd640 1 --2- 172.21.15.114:0/2276143774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c1610d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009870 tx=0x7f7d1c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f27fbe0b773b61f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d29ffb640 1 -- 172.21.15.114:0/2276143774 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c034070 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d29ffb640 1 -- 172.21.15.114:0/2276143774 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c030840 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d29ffb640 1 -- 172.21.15.114:0/2276143774 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c030c10 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 -- 172.21.15.114:0/2276143774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 msgr2=0x7f7d2c1610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 --2- 172.21.15.114:0/2276143774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c1610d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009870 tx=0x7f7d1c02b980 comp rx=0 tx=0).stop 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 -- 172.21.15.114:0/2276143774 shutdown_connections 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 --2- 172.21.15.114:0/2276143774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c0b3df0 0x7f7d2c09ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 --2- 172.21.15.114:0/2276143774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c1610d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 -- 172.21.15.114:0/2276143774 >> 172.21.15.114:0/2276143774 conn(0x7f7d2c0d2800 msgr2=0x7f7d2c0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 -- 172.21.15.114:0/2276143774 shutdown_connections 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.592+0000 7f7d3151e640 1 -- 172.21.15.114:0/2276143774 wait complete. 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.593+0000 7f7d3151e640 1 Processor -- start 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 -- start start 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c09b060 0x7f7d2c0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d2c0b3df0 0x7f7d2c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:21.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c0b2c40 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c161610 con 0x7f7d2c0b3df0 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d3151e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c0ce220 con 0x7f7d2c09b060 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d2b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d2b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59158/0 (socket says 172.21.15.114:59158) 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.594+0000 7f7d2b7fe640 1 -- 172.21.15.114:0/776002604 learned_addr learned my addr 172.21.15.114:0/776002604 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2a7fc640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d2c0b3df0 0x7f7d2c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2affd640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c09b060 0x7f7d2c0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2b7fe640 1 -- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c09b060 msgr2=0x7f7d2c0c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2b7fe640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c09b060 0x7f7d2c0c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2b7fe640 1 -- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d2c0b3df0 msgr2=0x7f7d2c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2b7fe640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d2c0b3df0 0x7f7d2c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:21.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2b7fe640 1 -- 172.21.15.114:0/776002604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c156240 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d2b7fe640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c157610 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400c700 tx=0x7f7d2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24018070 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2400ce10 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2c156520 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2400a880 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.595+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2c156ae0 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.596+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2c068c80 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.596+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d2401b070 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.597+0000 7f7d137fe640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7d1806c8f0 0x7f7d1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:21.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.597+0000 7f7d2affd640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7d1806c8f0 0x7f7d1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:21.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.597+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f7d2408ad40 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.597+0000 7f7d2affd640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7d1806c8f0 0x7f7d1806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c036000 tx=0x7f7d1c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:21.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.601+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d24059500 con 0x7f7d2c0cebc0 2024-04-13T02:45:21.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:21.787+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7d2c0d1210 con 0x7f7d2c0cebc0 2024-04-13T02:45:22.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.418+0000 7f7d137fe640 1 -- 172.21.15.114:0/776002604 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f7d24058e00 con 0x7f7d2c0cebc0 2024-04-13T02:45:22.419 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-04-13T02:45:22.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7d1806c8f0 msgr2=0x7f7d1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7d1806c8f0 0x7f7d1806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c036000 tx=0x7f7d1c03b040 comp rx=0 tx=0).stop 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 msgr2=0x7f7d2c157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c157610 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400c700 tx=0x7f7d2400cbc0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 shutdown_connections 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d2c0cebc0 0x7f7d2c157610 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d2c0b3df0 0x7f7d2c0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7d1806c8f0 0x7f7d1806edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 --2- 172.21.15.114:0/776002604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d2c09b060 0x7f7d2c0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 >> 172.21.15.114:0/776002604 conn(0x7f7d2c0d2800 msgr2=0x7f7d2c0d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 shutdown_connections 2024-04-13T02:45:22.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.421+0000 7f7d3151e640 1 -- 172.21.15.114:0/776002604 wait complete. 2024-04-13T02:45:22.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-13T02:45:22.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.533+0000 7f67f7be0640 1 Processor -- start 2024-04-13T02:45:22.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.533+0000 7f67f7be0640 1 -- start start 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.534+0000 7f67f7be0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f67f009b310 0x7f67f00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.534+0000 7f67f7be0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f00b5f40 con 0x7f67f015ca20 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.534+0000 7f67f7be0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f00b6220 con 0x7f67f00b5a10 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.534+0000 7f67f7be0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f67f015ce00 con 0x7f67f009b310 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.534+0000 7f67f597c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f67f015ca20 0x7f67f015d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41448/0 (socket says 172.21.15.114:41448) 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.534+0000 7f67f597c640 1 -- 172.21.15.114:0/3279868835 learned_addr learned my addr 172.21.15.114:0/3279868835 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766510429 0 0) 0x7f67f00b5f40 con 0x7f67f015ca20 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67dc003520 con 0x7f67f015ca20 2024-04-13T02:45:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f617d640 1 --2- 172.21.15.114:0/3279868835 >> v2:172.21.15.130:3300/0 conn(0x7f67f009b310 0x7f67f00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3843992056 0 0) 0x7f67dc003520 con 0x7f67f015ca20 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 >> v2:172.21.15.130:3300/0 conn(0x7f67f009b310 msgr2=0x7f67f00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 --2- 172.21.15.114:0/3279868835 >> v2:172.21.15.130:3300/0 conn(0x7f67f009b310 0x7f67f00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 >> v1:172.21.15.130:6789/0 conn(0x7f67f00b5a10 legacy=0x7f67f009ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f00b6500 con 0x7f67f015ca20 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f67ec0019f0 con 0x7f67f015ca20 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 >> v1:172.21.15.114:6789/0 conn(0x7f67f015ca20 legacy=0x7f67f015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc0039b0 0x7f67dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67dc004800 0x7f67dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67dc0051c0 0x7f67dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67f015ce00 con 0x7f67dc004800 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc00c060 con 0x7f67dc0039b0 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f67dc00c260 con 0x7f67dc0051c0 2024-04-13T02:45:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f517b640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67dc004800 0x7f67dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f597c640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc0039b0 0x7f67dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f617d640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67dc0051c0 0x7f67dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f517b640 1 -- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67dc0051c0 msgr2=0x7f67dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f517b640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67dc0051c0 0x7f67dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f517b640 1 -- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc0039b0 msgr2=0x7f67dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f517b640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc0039b0 0x7f67dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f517b640 1 -- 172.21.15.114:0/3279868835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc003520 con 0x7f67dc004800 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f617d640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67dc0051c0 0x7f67dc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.535+0000 7f67f617d640 1 -- 172.21.15.114:0/3279868835 reap_dead start 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.536+0000 7f67f517b640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67dc004800 0x7f67dc004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f67e0001750 tx=0x7f67dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c0a268aace768 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.536+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0001370 con 0x7f67dc004800 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.536+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e00052d0 con 0x7f67dc004800 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.536+0000 7f67f497a640 1 -- 172.21.15.114:0/3279868835 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0003830 con 0x7f67dc004800 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 -- 172.21.15.114:0/3279868835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67dc004800 msgr2=0x7f67dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67dc004800 0x7f67dc004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f67e0001750 tx=0x7f67dc005830 comp rx=0 tx=0).stop 2024-04-13T02:45:22.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 -- 172.21.15.114:0/3279868835 shutdown_connections 2024-04-13T02:45:22.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 --2- 172.21.15.114:0/3279868835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67dc004800 0x7f67dc004c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 -- 172.21.15.114:0/3279868835 >> 172.21.15.114:0/3279868835 conn(0x7f67f00b4400 msgr2=0x7f67f00b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:22.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 -- 172.21.15.114:0/3279868835 shutdown_connections 2024-04-13T02:45:22.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.537+0000 7f67f7be0640 1 -- 172.21.15.114:0/3279868835 wait complete. 2024-04-13T02:45:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.538+0000 7f67f7be0640 1 Processor -- start 2024-04-13T02:45:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.538+0000 7f67f7be0640 1 -- start start 2024-04-13T02:45:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc004800 0x7f67f01474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f009f6a0 0x7f67f009fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 0x7f67f015de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67f009ac00 con 0x7f67f015d990 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67f00b6ac0 con 0x7f67dc004800 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f67f009ad80 con 0x7f67f009f6a0 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 0x7f67f015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 0x7f67f015de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59170/0 (socket says 172.21.15.114:59170) 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 -- 172.21.15.114:0/1681008753 learned_addr learned my addr 172.21.15.114:0/1681008753 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f597c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc004800 0x7f67f01474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f517b640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f009f6a0 0x7f67f009fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 -- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f009f6a0 msgr2=0x7f67f009fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f009f6a0 0x7f67f009fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 -- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc004800 msgr2=0x7f67f01474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc004800 0x7f67f01474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 -- 172.21.15.114:0/1681008753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f015e630 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f617d640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 0x7f67f015de10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67f00d2720 tx=0x7f67e8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8019020 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e8003610 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f0147f40 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.539+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8003a00 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.540+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f0148500 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.540+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f0148700 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.541+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f67e801c020 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.541+0000 7f67e67fc640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67d406c920 0x7f67d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.541+0000 7f67f597c640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67d406c920 0x7f67d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.541+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f67e808b8c0 con 0x7f67f015d990 2024-04-13T02:45:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.542+0000 7f67f597c640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67d406c920 0x7f67d406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67ec001330 tx=0x7f67ec006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.546+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67f0148700 con 0x7f67f015d990 2024-04-13T02:45:22.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.787+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f67f0068c80 con 0x7f67f015d990 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.787+0000 7f67e67fc640 1 -- 172.21.15.114:0/1681008753 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f67e8023030 con 0x7f67f015d990 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8RlmbAC0GxAAMUQQKXce0pYUgpNZdCs3wg==", 2024-04-13T02:45:22.788 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8Rlm56mqLBAAYrVtGjrlPU7ljd6pUkjloQ==", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.789 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8Rlmm+8vIxAATcvDe8paFxOhaXPYRKkPxA==", 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.790 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8RlmOZ5/NBAAlg4mCQYWFulKOJupSHU71Q==", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBc8RlmtX6JHRAAS/WCg9LZPWrMeq6DxrkXkA==", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.791 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBf8Rlmyi9aHBAAuqQALUoBV4Vn75E//nG5yg==", 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-04-13T02:45:22.792 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBi8RlmZBZlGhAAzFY2b2F9pJ3mXjy5HBPbnw==", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBl8Rlmir8vGRAAsVtfAKxDwb9Pm4v9XLGowQ==", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.793 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBr8RlmrQCqHRAAbPwlvZwfZJ3fQPZCBRKxWg==", 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-04-13T02:45:22.794 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBu8RlmDYoAHBAAHmWw0pdFROhZZ68nvawwOw==", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBx8RlmjuJ/GhAAzFHXLvwV4WXN0+uuWBapmg==", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB08Rlmrkq7GRAAB9KPFvte8QP25sEwWiEEdA==", 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8RlmJv83ORAAjDE2/qy1zVmJSBcoX42cng==", 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.796 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBZ8Rlm2PfyBhAAe3QTSSnQ9m/hip2rf3MDJg==", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBZ8Rlm4bGHAxAA9+Rm8O/dxFiYTqY3FRIbrw==", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBZ8RlmtT3FDBAALuX7YexZj/F78l6wVrN3uw==", 2024-04-13T02:45:22.798 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBX8RlmBGZjOhAAGfrCO3ZeEPYXwXwhqFlJ1Q==", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-04-13T02:45:22.799 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/8RlmNZjdERAATG718yFuWfjcTWobJZJG8w==", 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/8Rlm35/dERAAnpVxU7OgZHPBU5Y5C+nCuA==", 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-13T02:45:22.800 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/8RlmmKbdERAA5qdc35mgW2dTMVA4EkgTLA==", 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/8RlmVq3dERAAiEVw+Y+HDYlMXRhSeSMD6A==", 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.801 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/8RlmlbbdERAA3k1xOv6zfGdEu9V0of9egg==", 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/8Rlm4L3dERAAsv/MNOpzQppu1KkJZToG3g==", 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.802 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8RlmostLGBAAh1tQ8pjAeHmf4JCv4LsLrQ==", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBY8Rlm6AwVFBAAzrnR08OP00PAndJKxPZDEQ==", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-04-13T02:45:22.803 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-04-13T02:45:22.804 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-04-13T02:45:22.804 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.804 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:22.804 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-04-13T02:45:22.804 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:45:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67d406c920 msgr2=0x7f67d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67d406c920 0x7f67d406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67ec001330 tx=0x7f67ec006040 comp rx=0 tx=0).stop 2024-04-13T02:45:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 msgr2=0x7f67f015de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 0x7f67f015de10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67f00d2720 tx=0x7f67e8011920 comp rx=0 tx=0).stop 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 shutdown_connections 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67f015d990 0x7f67f015de10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67d406c920 0x7f67d406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67f009f6a0 0x7f67f009fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 --2- 172.21.15.114:0/1681008753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67dc004800 0x7f67f01474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 >> 172.21.15.114:0/1681008753 conn(0x7f67f00b4400 msgr2=0x7f67f0070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 shutdown_connections 2024-04-13T02:45:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.789+0000 7f67f7be0640 1 -- 172.21.15.114:0/1681008753 wait complete. 2024-04-13T02:45:22.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-13T02:45:22.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.907+0000 7f931a1f7640 1 Processor -- start 2024-04-13T02:45:22.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.907+0000 7f931a1f7640 1 -- start start 2024-04-13T02:45:22.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.907+0000 7f931a1f7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93140ae5e0 0x7f931406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.907+0000 7f931a1f7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9314071330 con 0x7f93140b06b0 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.907+0000 7f931a1f7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93140ae9e0 con 0x7f931415e8d0 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.907+0000 7f931a1f7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f93140b47a0 con 0x7f93140ae5e0 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f9313fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93140ae5e0 0x7f931406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f930affd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f93140b06b0 0x7f93140b60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41450/0 (socket says 172.21.15.114:41450) 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f930affd640 1 -- 172.21.15.114:0/2575364992 learned_addr learned my addr 172.21.15.114:0/2575364992 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f9313fff640 1 -- 172.21.15.114:0/2575364992 >> v1:172.21.15.130:6789/0 conn(0x7f931415e8d0 legacy=0x7f93140b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f9313fff640 1 -- 172.21.15.114:0/2575364992 >> v1:172.21.15.114:6789/0 conn(0x7f93140b06b0 legacy=0x7f93140b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f9312ffd640 1 -- 172.21.15.114:0/2575364992 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62924318 0 0) 0x7f9314071330 con 0x7f93140b06b0 2024-04-13T02:45:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.908+0000 7f9313fff640 1 -- 172.21.15.114:0/2575364992 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93140b4a80 con 0x7f93140ae5e0 2024-04-13T02:45:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f9313fff640 1 --2- 172.21.15.114:0/2575364992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140ae5e0 0x7f931406ffe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f930c009d90 tx=0x7f930c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b108f8f0c66a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f9312ffd640 1 -- 172.21.15.114:0/2575364992 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c039070 con 0x7f93140ae5e0 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f9312ffd640 1 -- 172.21.15.114:0/2575364992 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930c02cc60 con 0x7f93140ae5e0 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f9312ffd640 1 -- 172.21.15.114:0/2575364992 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c034660 con 0x7f93140ae5e0 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 -- 172.21.15.114:0/2575364992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140ae5e0 msgr2=0x7f931406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 --2- 172.21.15.114:0/2575364992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140ae5e0 0x7f931406ffe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f930c009d90 tx=0x7f930c02beb0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 -- 172.21.15.114:0/2575364992 shutdown_connections 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 --2- 172.21.15.114:0/2575364992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140ae5e0 0x7f931406ffe0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 -- 172.21.15.114:0/2575364992 >> 172.21.15.114:0/2575364992 conn(0x7f93140b6b20 msgr2=0x7f93140b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 -- 172.21.15.114:0/2575364992 shutdown_connections 2024-04-13T02:45:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.909+0000 7f931a1f7640 1 -- 172.21.15.114:0/2575364992 wait complete. 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.910+0000 7f931a1f7640 1 Processor -- start 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 -- start start 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93140ae5e0 0x7f9314145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 0x7f9314153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f931415e8d0 0x7f9314154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f93140b67c0 con 0x7f93140b06b0 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9314071050 con 0x7f93140ae5e0 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f931a1f7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f93140b6940 con 0x7f931415e8d0 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.911+0000 7f930affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 0x7f9314153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 0x7f9314153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59190/0 (socket says 172.21.15.114:59190) 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 -- 172.21.15.114:0/463618833 learned_addr learned my addr 172.21.15.114:0/463618833 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f93137fe640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93140ae5e0 0x7f9314145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f9313fff640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f931415e8d0 0x7f9314154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 -- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f931415e8d0 msgr2=0x7f9314154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f931415e8d0 0x7f9314154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 -- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93140ae5e0 msgr2=0x7f9314145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93140ae5e0 0x7f9314145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 -- 172.21.15.114:0/463618833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93141548a0 con 0x7f93140b06b0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f930affd640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 0x7f9314153c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c4d0 tx=0x7f92fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc018070 con 0x7f93140b06b0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92fc0074e0 con 0x7f93140b06b0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9314154b80 con 0x7f93140b06b0 2024-04-13T02:45:22.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc004a20 con 0x7f93140b06b0 2024-04-13T02:45:22.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.912+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9314155140 con 0x7f93140b06b0 2024-04-13T02:45:22.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.913+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9314068c80 con 0x7f93140b06b0 2024-04-13T02:45:22.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.914+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92fc01b070 con 0x7f93140b06b0 2024-04-13T02:45:22.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.914+0000 7f9310ff9640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f92f406c8f0 0x7f92f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:22.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.914+0000 7f93137fe640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f92f406c8f0 0x7f92f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:22.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.914+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f92fc08aa20 con 0x7f93140b06b0 2024-04-13T02:45:22.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.915+0000 7f93137fe640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f92f406c8f0 0x7f92f406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9304006fd0 tx=0x7f9304009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:22.919+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92fc058b50 con 0x7f93140b06b0 2024-04-13T02:45:23.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.159+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f9314070a80 con 0x7f93140b06b0 2024-04-13T02:45:23.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.160+0000 7f9310ff9640 1 -- 172.21.15.114:0/463618833 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f92fc05ce50 con 0x7f93140b06b0 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f92f406c8f0 msgr2=0x7f92f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f92f406c8f0 0x7f92f406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9304006fd0 tx=0x7f9304009060 comp rx=0 tx=0).stop 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 msgr2=0x7f9314153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 0x7f9314153c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c4d0 tx=0x7f92fc00c990 comp rx=0 tx=0).stop 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 shutdown_connections 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f92f406c8f0 0x7f92f406edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f931415e8d0 0x7f9314154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93140b06b0 0x7f9314153c20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 --2- 172.21.15.114:0/463618833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93140ae5e0 0x7f9314145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 >> 172.21.15.114:0/463618833 conn(0x7f93140b6b20 msgr2=0x7f93140b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:23.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 shutdown_connections 2024-04-13T02:45:23.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.163+0000 7f931a1f7640 1 -- 172.21.15.114:0/463618833 wait complete. 2024-04-13T02:45:23.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-13T02:45:23.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.274+0000 7f423e7aa640 1 Processor -- start 2024-04-13T02:45:23.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.274+0000 7f423e7aa640 1 -- start start 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423e7aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423e7aa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4238072580 0x7f423806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423e7aa640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f423815d200 con 0x7f4238072100 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423e7aa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f42380a95b0 con 0x7f4238072580 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423e7aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f423815d4e0 con 0x7f423813f6a0 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4238072580 0x7f423806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4238072580 0x7f423806e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59206/0 (socket says 172.21.15.114:59206) 2024-04-13T02:45:23.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 -- 172.21.15.114:0/2501586709 learned_addr learned my addr 172.21.15.114:0/2501586709 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f4237fff640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 -- 172.21.15.114:0/2501586709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 msgr2=0x7f42380ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 -- 172.21.15.114:0/2501586709 >> v1:172.21.15.130:6789/0 conn(0x7f4238072100 legacy=0x7f423806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.275+0000 7f423cd47640 1 -- 172.21.15.114:0/2501586709 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423815d7c0 con 0x7f4238072580 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.276+0000 7f4237fff640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.276+0000 7f423cd47640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072580 0x7f423806e810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4230009e50 tx=0x7f423002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dbaa081783a6a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.276+0000 7f4236ffd640 1 -- 172.21.15.114:0/2501586709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423002cb00 con 0x7f4238072580 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.276+0000 7f4236ffd640 1 -- 172.21.15.114:0/2501586709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423002cca0 con 0x7f4238072580 2024-04-13T02:45:23.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.276+0000 7f4236ffd640 1 -- 172.21.15.114:0/2501586709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230034610 con 0x7f4238072580 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 -- 172.21.15.114:0/2501586709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072580 msgr2=0x7f423806e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072580 0x7f423806e810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4230009e50 tx=0x7f423002bf60 comp rx=0 tx=0).stop 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 -- 172.21.15.114:0/2501586709 shutdown_connections 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072580 0x7f423806e810 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 --2- 172.21.15.114:0/2501586709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 -- 172.21.15.114:0/2501586709 >> 172.21.15.114:0/2501586709 conn(0x7f42380b2460 msgr2=0x7f42380b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 -- 172.21.15.114:0/2501586709 shutdown_connections 2024-04-13T02:45:23.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.277+0000 7f423e7aa640 1 -- 172.21.15.114:0/2501586709 wait complete. 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.278+0000 7f423e7aa640 1 Processor -- start 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.278+0000 7f423e7aa640 1 -- start start 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423e7aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 0x7f42380aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423e7aa640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4238072580 0x7f42381559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423e7aa640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423e7aa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f423813fef0 con 0x7f4238072100 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423e7aa640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42380729f0 con 0x7f4238072580 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423e7aa640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f423815dd80 con 0x7f423813f6a0 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 0x7f42380aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 0x7f42380aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59220/0 (socket says 172.21.15.114:59220) 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 -- 172.21.15.114:0/1942026708 learned_addr learned my addr 172.21.15.114:0/1942026708 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f42377fe640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4238072580 0x7f42381559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f423cd47640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 -- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 msgr2=0x7f42380ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 -- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4238072580 msgr2=0x7f42381559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4238072580 0x7f42381559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.279+0000 7f4237fff640 1 -- 172.21.15.114:0/1942026708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42380aa980 con 0x7f4238072100 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.280+0000 7f4237fff640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 0x7f42380aa150 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f422800e7e0 tx=0x7f422800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.280+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422800f040 con 0x7f4238072100 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.280+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4228004030 con 0x7f4238072100 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.280+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42380aac60 con 0x7f4238072100 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.280+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228004400 con 0x7f4238072100 2024-04-13T02:45:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.280+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4238157aa0 con 0x7f4238072100 2024-04-13T02:45:23.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.281+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4238068c80 con 0x7f4238072100 2024-04-13T02:45:23.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.281+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f422800c6d0 con 0x7f4238072100 2024-04-13T02:45:23.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.281+0000 7f4234ff9640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f422406c8f0 0x7f422406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.282+0000 7f42377fe640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f422406c8f0 0x7f422406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.282+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f422808b4e0 con 0x7f4238072100 2024-04-13T02:45:23.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.282+0000 7f42377fe640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f422406c8f0 0x7f422406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42380aaf60 tx=0x7f422c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.286+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4228017020 con 0x7f4238072100 2024-04-13T02:45:23.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.531+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f42381411a0 con 0x7f4238072100 2024-04-13T02:45:23.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.533+0000 7f4234ff9640 1 -- 172.21.15.114:0/1942026708 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f42280596a0 con 0x7f4238072100 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f422406c8f0 msgr2=0x7f422406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f422406c8f0 0x7f422406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42380aaf60 tx=0x7f422c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 msgr2=0x7f42380aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 0x7f42380aa150 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f422800e7e0 tx=0x7f422800eca0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 shutdown_connections 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f422406c8f0 0x7f422406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f423813f6a0 0x7f42380ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4238072580 0x7f42381559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 --2- 172.21.15.114:0/1942026708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4238072100 0x7f42380aa150 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 >> 172.21.15.114:0/1942026708 conn(0x7f42380b2460 msgr2=0x7f42380b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:23.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 shutdown_connections 2024-04-13T02:45:23.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.535+0000 7f423e7aa640 1 -- 172.21.15.114:0/1942026708 wait complete. 2024-04-13T02:45:23.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-13T02:45:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.646+0000 7fc11d80f640 1 Processor -- start 2024-04-13T02:45:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.646+0000 7fc11d80f640 1 -- start start 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc11d80f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1180b06b0 0x7fc1180ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc11d80f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc11806ffe0 0x7fc1180b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc11d80f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc118071330 con 0x7fc11815e8d0 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc11d80f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc1180703e0 con 0x7fc1180b06b0 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc11d80f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc1180b47a0 con 0x7fc11806ffe0 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1167fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1180b06b0 0x7fc1180ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc116ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc11815e8d0 0x7fc1180b0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41466/0 (socket says 172.21.15.114:41466) 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc116ffd640 1 -- 172.21.15.114:0/474516933 learned_addr learned my addr 172.21.15.114:0/474516933 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1167fc640 1 -- 172.21.15.114:0/474516933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc11806ffe0 msgr2=0x7fc1180b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1177fe640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc11806ffe0 0x7fc1180b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1167fc640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc11806ffe0 0x7fc1180b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1167fc640 1 -- 172.21.15.114:0/474516933 >> v1:172.21.15.114:6789/0 conn(0x7fc11815e8d0 legacy=0x7fc1180b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1167fc640 1 -- 172.21.15.114:0/474516933 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1180b4a80 con 0x7fc1180b06b0 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc115ffb640 1 -- 172.21.15.114:0/474516933 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613643970 0 0) 0x7fc118071330 con 0x7fc11815e8d0 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.647+0000 7fc1177fe640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc11806ffe0 0x7fc1180b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.648+0000 7fc1167fc640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1180b06b0 0x7fc1180ae5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0097a0 tx=0x7fc10c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244ada60cb6329eb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.648+0000 7fc115ffb640 1 -- 172.21.15.114:0/474516933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0315a0 con 0x7fc1180b06b0 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.648+0000 7fc115ffb640 1 -- 172.21.15.114:0/474516933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c037070 con 0x7fc1180b06b0 2024-04-13T02:45:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.648+0000 7fc115ffb640 1 -- 172.21.15.114:0/474516933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031960 con 0x7fc1180b06b0 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 -- 172.21.15.114:0/474516933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1180b06b0 msgr2=0x7fc1180ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1180b06b0 0x7fc1180ae5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0097a0 tx=0x7fc10c02b840 comp rx=0 tx=0).stop 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 -- 172.21.15.114:0/474516933 shutdown_connections 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc11806ffe0 0x7fc1180b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 --2- 172.21.15.114:0/474516933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1180b06b0 0x7fc1180ae5e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 -- 172.21.15.114:0/474516933 >> 172.21.15.114:0/474516933 conn(0x7fc1180b6b20 msgr2=0x7fc1180b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 -- 172.21.15.114:0/474516933 shutdown_connections 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.649+0000 7fc11d80f640 1 -- 172.21.15.114:0/474516933 wait complete. 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.650+0000 7fc11d80f640 1 Processor -- start 2024-04-13T02:45:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.650+0000 7fc11d80f640 1 -- start start 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc11d80f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc11806ffe0 0x7fc1181f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc11d80f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1180b06b0 0x7fc11806b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc11d80f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 0x7fc11806be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc11d80f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc11815ecb0 con 0x7fc11815e8d0 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc11d80f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc118071050 con 0x7fc11806ffe0 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc11d80f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc11815ee30 con 0x7fc1180b06b0 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 0x7fc11806be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 0x7fc11806be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59238/0 (socket says 172.21.15.114:59238) 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 -- 172.21.15.114:0/3248782128 learned_addr learned my addr 172.21.15.114:0/3248782128 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1167fc640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1180b06b0 0x7fc11806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc116ffd640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc11806ffe0 0x7fc1181f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 -- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1180b06b0 msgr2=0x7fc11806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1180b06b0 0x7fc11806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 -- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc11806ffe0 msgr2=0x7fc1181f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc11806ffe0 0x7fc1181f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.651+0000 7fc1177fe640 1 -- 172.21.15.114:0/3248782128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc118161780 con 0x7fc11815e8d0 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.652+0000 7fc1177fe640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 0x7fc11806be70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc11000cd50 tx=0x7fc11000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.652+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11000f680 con 0x7fc11815e8d0 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.652+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11000f840 con 0x7fc11815e8d0 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.652+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc118148b00 con 0x7fc11815e8d0 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.652+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11000fc30 con 0x7fc11815e8d0 2024-04-13T02:45:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.652+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1181f4180 con 0x7fc11815e8d0 2024-04-13T02:45:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.653+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc118068c80 con 0x7fc11815e8d0 2024-04-13T02:45:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.653+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1100213f0 con 0x7fc11815e8d0 2024-04-13T02:45:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.654+0000 7fc0fffff640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc10406c8f0 0x7fc10406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.654+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc11008c3d0 con 0x7fc11815e8d0 2024-04-13T02:45:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.654+0000 7fc116ffd640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc10406c8f0 0x7fc10406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:23.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.654+0000 7fc116ffd640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc10406c8f0 0x7fc10406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc108007fd0 tx=0x7fc108007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:23.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.658+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc110014030 con 0x7fc11815e8d0 2024-04-13T02:45:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.901+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fc11815dd40 con 0x7fc11815e8d0 2024-04-13T02:45:23.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.903+0000 7fc0fffff640 1 -- 172.21.15.114:0/3248782128 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fc11005a590 con 0x7fc11815e8d0 2024-04-13T02:45:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc10406c8f0 msgr2=0x7fc10406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc10406c8f0 0x7fc10406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc108007fd0 tx=0x7fc108007de0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 msgr2=0x7fc11806be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:23.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 0x7fc11806be70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc11000cd50 tx=0x7fc11000a650 comp rx=0 tx=0).stop 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 shutdown_connections 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc11815e8d0 0x7fc11806be70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc10406c8f0 0x7fc10406edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc1180b06b0 0x7fc11806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 --2- 172.21.15.114:0/3248782128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc11806ffe0 0x7fc1181f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 >> 172.21.15.114:0/3248782128 conn(0x7fc1180b6b20 msgr2=0x7fc11806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 shutdown_connections 2024-04-13T02:45:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:23.905+0000 7fc11d80f640 1 -- 172.21.15.114:0/3248782128 wait complete. 2024-04-13T02:45:23.917 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-13T02:45:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.017+0000 7f451b4de640 1 Processor -- start 2024-04-13T02:45:24.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.017+0000 7f451b4de640 1 -- start start 2024-04-13T02:45:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f451b4de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f451415ea80 0x7f4514070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f451b4de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4514071530 0x7f451406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f451b4de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45140ccda0 con 0x7f451409baf0 2024-04-13T02:45:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f451b4de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f45140cd6b0 con 0x7f4514071530 2024-04-13T02:45:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f451b4de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f451409bff0 con 0x7f451415ea80 2024-04-13T02:45:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f4519a7b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4514071530 0x7f451406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f4518a79640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f451409baf0 0x7f4514070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41474/0 (socket says 172.21.15.114:41474) 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f4518a79640 1 -- 172.21.15.114:0/2020278089 learned_addr learned my addr 172.21.15.114:0/2020278089 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.018+0000 7f451927a640 1 --2- 172.21.15.114:0/2020278089 >> v2:172.21.15.130:3300/0 conn(0x7f451415ea80 0x7f4514070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f4519a7b640 1 -- 172.21.15.114:0/2020278089 >> v2:172.21.15.130:3300/0 conn(0x7f451415ea80 msgr2=0x7f4514070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f4519a7b640 1 --2- 172.21.15.114:0/2020278089 >> v2:172.21.15.130:3300/0 conn(0x7f451415ea80 0x7f4514070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f4519a7b640 1 -- 172.21.15.114:0/2020278089 >> v1:172.21.15.114:6789/0 conn(0x7f451409baf0 legacy=0x7f4514070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f450bfff640 1 -- 172.21.15.114:0/2020278089 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670469126 0 0) 0x7f45140ccda0 con 0x7f451409baf0 2024-04-13T02:45:24.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f4519a7b640 1 -- 172.21.15.114:0/2020278089 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45140cd060 con 0x7f4514071530 2024-04-13T02:45:24.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f4519a7b640 1 --2- 172.21.15.114:0/2020278089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4514071530 0x7f451406dca0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f45140cd830 tx=0x7f450c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c5b8e676c61340 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f450bfff640 1 -- 172.21.15.114:0/2020278089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c039070 con 0x7f4514071530 2024-04-13T02:45:24.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f450bfff640 1 -- 172.21.15.114:0/2020278089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c02cd00 con 0x7f4514071530 2024-04-13T02:45:24.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.019+0000 7f450bfff640 1 -- 172.21.15.114:0/2020278089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c034660 con 0x7f4514071530 2024-04-13T02:45:24.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 -- 172.21.15.114:0/2020278089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4514071530 msgr2=0x7f451406dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 --2- 172.21.15.114:0/2020278089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4514071530 0x7f451406dca0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f45140cd830 tx=0x7f450c02bf50 comp rx=0 tx=0).stop 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 -- 172.21.15.114:0/2020278089 shutdown_connections 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 --2- 172.21.15.114:0/2020278089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4514071530 0x7f451406dca0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 --2- 172.21.15.114:0/2020278089 >> v2:172.21.15.130:3300/0 conn(0x7f451415ea80 0x7f4514070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 -- 172.21.15.114:0/2020278089 >> 172.21.15.114:0/2020278089 conn(0x7f45140d2750 msgr2=0x7f45140d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 -- 172.21.15.114:0/2020278089 shutdown_connections 2024-04-13T02:45:24.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.020+0000 7f451b4de640 1 -- 172.21.15.114:0/2020278089 wait complete. 2024-04-13T02:45:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.021+0000 7f451b4de640 1 Processor -- start 2024-04-13T02:45:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.021+0000 7f451b4de640 1 -- start start 2024-04-13T02:45:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451b4de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4514071530 0x7f451414b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451b4de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 0x7f451414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451b4de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f451415ea80 0x7f45140cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451b4de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f451406ca40 con 0x7f451409baf0 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451b4de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4514070b60 con 0x7f451415ea80 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451b4de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f451415ee60 con 0x7f4514071530 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 0x7f451414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 0x7f451414e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59268/0 (socket says 172.21.15.114:59268) 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 -- 172.21.15.114:0/462422096 learned_addr learned my addr 172.21.15.114:0/462422096 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4519a7b640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f451415ea80 0x7f45140cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f451927a640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4514071530 0x7f451414b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 -- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4514071530 msgr2=0x7f451414b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4514071530 0x7f451414b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 -- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f451415ea80 msgr2=0x7f45140cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f451415ea80 0x7f45140cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 -- 172.21.15.114:0/462422096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451414ee50 con 0x7f451409baf0 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.022+0000 7f4518a79640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 0x7f451414e910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f450400c4d0 tx=0x7f450400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.023+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504018070 con 0x7f451409baf0 2024-04-13T02:45:24.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.023+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4504007500 con 0x7f451409baf0 2024-04-13T02:45:24.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.023+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451415f500 con 0x7f451409baf0 2024-04-13T02:45:24.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.023+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504004a20 con 0x7f451409baf0 2024-04-13T02:45:24.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.023+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451415fac0 con 0x7f451409baf0 2024-04-13T02:45:24.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.024+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4514068c80 con 0x7f451409baf0 2024-04-13T02:45:24.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.024+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f450401b070 con 0x7f451409baf0 2024-04-13T02:45:24.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.024+0000 7f4509ffb640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44f806c8f0 0x7f44f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.024+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f450408aa90 con 0x7f451409baf0 2024-04-13T02:45:24.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.024+0000 7f451927a640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44f806c8f0 0x7f44f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.025+0000 7f451927a640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44f806c8f0 0x7f44f806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4510009a30 tx=0x7f4510008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.029+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4504058bc0 con 0x7f451409baf0 2024-04-13T02:45:24.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.271+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f45140b4050 con 0x7f451409baf0 2024-04-13T02:45:24.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.273+0000 7f4509ffb640 1 -- 172.21.15.114:0/462422096 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f450405cec0 con 0x7f451409baf0 2024-04-13T02:45:24.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44f806c8f0 msgr2=0x7f44f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44f806c8f0 0x7f44f806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4510009a30 tx=0x7f4510008040 comp rx=0 tx=0).stop 2024-04-13T02:45:24.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 msgr2=0x7f451414e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 0x7f451414e910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f450400c4d0 tx=0x7f450400c990 comp rx=0 tx=0).stop 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 shutdown_connections 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f451415ea80 0x7f45140cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451409baf0 0x7f451414e910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44f806c8f0 0x7f44f806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 --2- 172.21.15.114:0/462422096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4514071530 0x7f451414b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.275+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 >> 172.21.15.114:0/462422096 conn(0x7f45140d2750 msgr2=0x7f451415dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.276+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 shutdown_connections 2024-04-13T02:45:24.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.276+0000 7f451b4de640 1 -- 172.21.15.114:0/462422096 wait complete. 2024-04-13T02:45:24.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-13T02:45:24.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 Processor -- start 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 -- start start 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b0415dc00 0x7f3b040d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b040cd1b0 0x7f3b040d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b040cd690 con 0x7f3b04160520 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3b040ce2a0 con 0x7f3b0415dc00 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b0ae0f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3b040cd970 con 0x7f3b040cd1b0 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b03fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b0415dc00 0x7f3b040d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b03fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b0415dc00 0x7f3b040d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59280/0 (socket says 172.21.15.114:59280) 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.388+0000 7f3b03fff640 1 -- 172.21.15.114:0/459429961 learned_addr learned my addr 172.21.15.114:0/459429961 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.389+0000 7f3b093ac640 1 --2- 172.21.15.114:0/459429961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b040cd1b0 0x7f3b040d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.389+0000 7f3b03fff640 1 -- 172.21.15.114:0/459429961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b040cd1b0 msgr2=0x7f3b040d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.389+0000 7f3b03fff640 1 --2- 172.21.15.114:0/459429961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b040cd1b0 0x7f3b040d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.389+0000 7f3b03fff640 1 -- 172.21.15.114:0/459429961 >> v1:172.21.15.130:6789/0 conn(0x7f3b04160520 legacy=0x7f3b04160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.389+0000 7f3b03fff640 1 -- 172.21.15.114:0/459429961 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b040cdc50 con 0x7f3b0415dc00 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.389+0000 7f3b03fff640 1 --2- 172.21.15.114:0/459429961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040d0d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009870 tx=0x7f3af402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7964cc99afdf5f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b037fe640 1 -- 172.21.15.114:0/459429961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4034070 con 0x7f3b0415dc00 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b037fe640 1 -- 172.21.15.114:0/459429961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4030840 con 0x7f3b0415dc00 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b037fe640 1 -- 172.21.15.114:0/459429961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4030c10 con 0x7f3b0415dc00 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/459429961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 msgr2=0x7f3b040d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/459429961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040d0d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009870 tx=0x7f3af402b980 comp rx=0 tx=0).stop 2024-04-13T02:45:24.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/459429961 shutdown_connections 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/459429961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b040cd1b0 0x7f3b040d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/459429961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040d0d90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/459429961 >> 172.21.15.114:0/459429961 conn(0x7f3b040d2740 msgr2=0x7f3b040d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/459429961 shutdown_connections 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.390+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/459429961 wait complete. 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.391+0000 7f3b0ae0f640 1 Processor -- start 2024-04-13T02:45:24.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.391+0000 7f3b0ae0f640 1 -- start start 2024-04-13T02:45:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b0ae0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b040cd1b0 0x7f3b040b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b0ae0f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b0ae0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b04160520 0x7f3b040d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b0ae0f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0409aca0 con 0x7f3b0415dc00 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b0ae0f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0409ab20 con 0x7f3b040cd1b0 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b0ae0f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0409ae20 con 0x7f3b04160520 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59286/0 (socket says 172.21.15.114:59286) 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b03fff640 1 -- 172.21.15.114:0/1947786250 learned_addr learned my addr 172.21.15.114:0/1947786250 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b093ac640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b04160520 0x7f3b040d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.392+0000 7f3b08bab640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b040cd1b0 0x7f3b040b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b03fff640 1 -- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b04160520 msgr2=0x7f3b040d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b03fff640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b04160520 0x7f3b040d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b03fff640 1 -- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b040cd1b0 msgr2=0x7f3b040b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b03fff640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b040cd1b0 0x7f3b040b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b03fff640 1 -- 172.21.15.114:0/1947786250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b041f88b0 con 0x7f3b0415dc00 2024-04-13T02:45:24.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b03fff640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040cfe70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3af402b9c0 tx=0x7f3af4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4048070 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4030640 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4034040 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b041f8b90 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.393+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040b1800 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.394+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b04068c80 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.394+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3af404b070 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.395+0000 7f3b017fa640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3ae406c8f0 0x7f3ae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.395+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f3af40ad610 con 0x7f3b0415dc00 2024-04-13T02:45:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.395+0000 7f3b08bab640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3ae406c8f0 0x7f3ae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.395+0000 7f3b08bab640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3ae406c8f0 0x7f3ae406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001e70 tx=0x7f3afc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.399+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3af407b7d0 con 0x7f3b0415dc00 2024-04-13T02:45:24.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.643+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3b040723a0 con 0x7f3b0415dc00 2024-04-13T02:45:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.645+0000 7f3b017fa640 1 -- 172.21.15.114:0/1947786250 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f3af407fad0 con 0x7f3b0415dc00 2024-04-13T02:45:24.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3ae406c8f0 msgr2=0x7f3ae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3ae406c8f0 0x7f3ae406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001e70 tx=0x7f3afc009040 comp rx=0 tx=0).stop 2024-04-13T02:45:24.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 msgr2=0x7f3b040cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040cfe70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3af402b9c0 tx=0x7f3af4004730 comp rx=0 tx=0).stop 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 shutdown_connections 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3ae406c8f0 0x7f3ae406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b04160520 0x7f3b040d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b0415dc00 0x7f3b040cfe70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 --2- 172.21.15.114:0/1947786250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b040cd1b0 0x7f3b040b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 >> 172.21.15.114:0/1947786250 conn(0x7f3b040d2740 msgr2=0x7f3b04160900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 shutdown_connections 2024-04-13T02:45:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.647+0000 7f3b0ae0f640 1 -- 172.21.15.114:0/1947786250 wait complete. 2024-04-13T02:45:24.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-13T02:45:24.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.759+0000 7f6957d1e640 1 Processor -- start 2024-04-13T02:45:24.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.759+0000 7f6957d1e640 1 -- start start 2024-04-13T02:45:24.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6957d1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f69500b5790 0x7f69500b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6957d1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69500b60b0 0x7f69500b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6957d1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69500b3d00 con 0x7f69501625d0 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6957d1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f695015efe0 con 0x7f69500b5790 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6957d1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f695015f2a0 con 0x7f69500b60b0 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69562bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69500b60b0 0x7f69500b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6955aba640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f69500b5790 0x7f69500b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69552b9640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f69501625d0 0x7f69500b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:52212/0 (socket says 172.21.15.114:52212) 2024-04-13T02:45:24.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69552b9640 1 -- 172.21.15.114:0/836957141 learned_addr learned my addr 172.21.15.114:0/836957141 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69562bb640 1 -- 172.21.15.114:0/836957141 >> v2:172.21.15.130:3300/0 conn(0x7f69500b5790 msgr2=0x7f69500b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69562bb640 1 --2- 172.21.15.114:0/836957141 >> v2:172.21.15.130:3300/0 conn(0x7f69500b5790 0x7f69500b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69562bb640 1 -- 172.21.15.114:0/836957141 >> v1:172.21.15.130:6789/0 conn(0x7f69501625d0 legacy=0x7f69500b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f69562bb640 1 -- 172.21.15.114:0/836957141 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695015f580 con 0x7f69500b60b0 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.760+0000 7f6955aba640 1 --2- 172.21.15.114:0/836957141 >> v2:172.21.15.130:3300/0 conn(0x7f69500b5790 0x7f69500b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.761+0000 7f69562bb640 1 --2- 172.21.15.114:0/836957141 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69500b60b0 0x7f69500b4830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6948009d90 tx=0x7f694802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e78b994762379 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.761+0000 7f6954ab8640 1 -- 172.21.15.114:0/836957141 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948039070 con 0x7f69500b60b0 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.761+0000 7f6954ab8640 1 -- 172.21.15.114:0/836957141 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694802cc60 con 0x7f69500b60b0 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.761+0000 7f6954ab8640 1 -- 172.21.15.114:0/836957141 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948034660 con 0x7f69500b60b0 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 -- 172.21.15.114:0/836957141 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69500b60b0 msgr2=0x7f69500b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 --2- 172.21.15.114:0/836957141 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69500b60b0 0x7f69500b4830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6948009d90 tx=0x7f694802beb0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 -- 172.21.15.114:0/836957141 shutdown_connections 2024-04-13T02:45:24.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 --2- 172.21.15.114:0/836957141 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69500b60b0 0x7f69500b4830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 --2- 172.21.15.114:0/836957141 >> v2:172.21.15.130:3300/0 conn(0x7f69500b5790 0x7f69500b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 -- 172.21.15.114:0/836957141 >> 172.21.15.114:0/836957141 conn(0x7f695006eb10 msgr2=0x7f695006ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:24.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 -- 172.21.15.114:0/836957141 shutdown_connections 2024-04-13T02:45:24.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.762+0000 7f6957d1e640 1 -- 172.21.15.114:0/836957141 wait complete. 2024-04-13T02:45:24.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.763+0000 7f6957d1e640 1 Processor -- start 2024-04-13T02:45:24.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.763+0000 7f6957d1e640 1 -- start start 2024-04-13T02:45:24.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6957d1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69500b5790 0x7f6950159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6957d1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 0x7f6950150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6957d1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6950159150 0x7f69501f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6957d1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f695015c850 con 0x7f69500b60b0 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6957d1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f695015fb40 con 0x7f69500b5790 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6957d1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f695015c9d0 con 0x7f6950159150 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 0x7f6950150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 0x7f6950150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59290/0 (socket says 172.21.15.114:59290) 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 -- 172.21.15.114:0/3458016353 learned_addr learned my addr 172.21.15.114:0/3458016353 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f6955aba640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69500b5790 0x7f6950159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69562bb640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6950159150 0x7f69501f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 -- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6950159150 msgr2=0x7f69501f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6950159150 0x7f69501f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 -- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69500b5790 msgr2=0x7f6950159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69500b5790 0x7f6950159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:24.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 -- 172.21.15.114:0/3458016353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6950159650 con 0x7f69500b60b0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.764+0000 7f69552b9640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 0x7f6950150690 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f694000c400 tx=0x7f694000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.765+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940017070 con 0x7f69500b60b0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.765+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940005ce0 con 0x7f69500b60b0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.765+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400072f0 con 0x7f69500b60b0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.765+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6950157b00 con 0x7f69500b60b0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.765+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501580c0 con 0x7f69500b60b0 2024-04-13T02:45:24.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.766+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69500cd650 con 0x7f69500b60b0 2024-04-13T02:45:24.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.766+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f694001a070 con 0x7f69500b60b0 2024-04-13T02:45:24.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.766+0000 7f69467fc640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f693406c8f0 0x7f693406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:24.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.767+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f694008ab60 con 0x7f69500b60b0 2024-04-13T02:45:24.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.767+0000 7f6955aba640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f693406c8f0 0x7f693406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:24.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.767+0000 7f6955aba640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f693406c8f0 0x7f693406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f694c009560 tx=0x7f694c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:24.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:24.771+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f69500cd650 con 0x7f69500b60b0 2024-04-13T02:45:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.012+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f6950068c80 con 0x7f69500b60b0 2024-04-13T02:45:25.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.016+0000 7f69467fc640 1 -- 172.21.15.114:0/3458016353 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f69500b3d00 con 0x7f69500b60b0 2024-04-13T02:45:25.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f693406c8f0 msgr2=0x7f693406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f693406c8f0 0x7f693406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f694c009560 tx=0x7f694c009190 comp rx=0 tx=0).stop 2024-04-13T02:45:25.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 msgr2=0x7f6950150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 0x7f6950150690 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f694000c400 tx=0x7f694000c8c0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 shutdown_connections 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f693406c8f0 0x7f693406edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6950159150 0x7f69501f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500b60b0 0x7f6950150690 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 --2- 172.21.15.114:0/3458016353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69500b5790 0x7f6950159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 >> 172.21.15.114:0/3458016353 conn(0x7f695006eb10 msgr2=0x7f695015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 shutdown_connections 2024-04-13T02:45:25.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.018+0000 7f6957d1e640 1 -- 172.21.15.114:0/3458016353 wait complete. 2024-04-13T02:45:25.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.130+0000 7f7bee636640 1 Processor -- start 2024-04-13T02:45:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.130+0000 7f7bee636640 1 -- start start 2024-04-13T02:45:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7bee636640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be815ea70 0x7f7be80b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7bee636640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7be80b12e0 0x7f7be80b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7bee636640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be80b1860 con 0x7f7be80b4810 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7bee636640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f7be80b1b40 con 0x7f7be815ea70 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7bee636640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7be80b1e20 con 0x7f7be80b12e0 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be815ea70 0x7f7be80b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7be815ea70 0x7f7be80b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59306/0 (socket says 172.21.15.114:59306) 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 -- 172.21.15.114:0/2604052943 learned_addr learned my addr 172.21.15.114:0/2604052943 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be77fe640 1 --2- 172.21.15.114:0/2604052943 >> v2:172.21.15.130:3300/0 conn(0x7f7be80b12e0 0x7f7be80b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 -- 172.21.15.114:0/2604052943 >> v2:172.21.15.130:3300/0 conn(0x7f7be80b12e0 msgr2=0x7f7be80b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 --2- 172.21.15.114:0/2604052943 >> v2:172.21.15.130:3300/0 conn(0x7f7be80b12e0 0x7f7be80b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 -- 172.21.15.114:0/2604052943 >> v1:172.21.15.130:6789/0 conn(0x7f7be80b4810 legacy=0x7f7be806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.131+0000 7f7be7fff640 1 -- 172.21.15.114:0/2604052943 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80b2100 con 0x7f7be815ea70 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.132+0000 7f7be7fff640 1 --2- 172.21.15.114:0/2604052943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be815ea70 0x7f7be80b5320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7be8071a90 tx=0x7f7bd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679b699479f534f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.132+0000 7f7be6ffd640 1 -- 172.21.15.114:0/2604052943 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8035020 con 0x7f7be815ea70 2024-04-13T02:45:25.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.132+0000 7f7be6ffd640 1 -- 172.21.15.114:0/2604052943 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd8031870 con 0x7f7be815ea70 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.132+0000 7f7be6ffd640 1 -- 172.21.15.114:0/2604052943 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8031c40 con 0x7f7be815ea70 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 -- 172.21.15.114:0/2604052943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be815ea70 msgr2=0x7f7be80b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 --2- 172.21.15.114:0/2604052943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be815ea70 0x7f7be80b5320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7be8071a90 tx=0x7f7bd802b910 comp rx=0 tx=0).stop 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 -- 172.21.15.114:0/2604052943 shutdown_connections 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 --2- 172.21.15.114:0/2604052943 >> v2:172.21.15.130:3300/0 conn(0x7f7be80b12e0 0x7f7be80b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 --2- 172.21.15.114:0/2604052943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be815ea70 0x7f7be80b5320 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 -- 172.21.15.114:0/2604052943 >> 172.21.15.114:0/2604052943 conn(0x7f7be80b6f50 msgr2=0x7f7be809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 -- 172.21.15.114:0/2604052943 shutdown_connections 2024-04-13T02:45:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.133+0000 7f7bee636640 1 -- 172.21.15.114:0/2604052943 wait complete. 2024-04-13T02:45:25.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.134+0000 7f7bee636640 1 Processor -- start 2024-04-13T02:45:25.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.134+0000 7f7bee636640 1 -- start start 2024-04-13T02:45:25.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7be80b12e0 0x7f7be8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 0x7f7be8156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7be815ea70 0x7f7be80af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7be815efd0 con 0x7f7be80b4810 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7be815ee50 con 0x7f7be815ea70 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7be809b2a0 con 0x7f7be80b12e0 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 0x7f7be8156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 0x7f7be8156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59312/0 (socket says 172.21.15.114:59312) 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 -- 172.21.15.114:0/1448176349 learned_addr learned my addr 172.21.15.114:0/1448176349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7becbd3640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7be815ea70 0x7f7be80af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be7fff640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7be80b12e0 0x7f7be8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 -- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7be80b12e0 msgr2=0x7f7be8154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7be80b12e0 0x7f7be8154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 -- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7be815ea70 msgr2=0x7f7be80af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7be815ea70 0x7f7be80af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 -- 172.21.15.114:0/1448176349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be8161c20 con 0x7f7be80b4810 2024-04-13T02:45:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be77fe640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 0x7f7be8156af0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00d5a0 tx=0x7f7bdc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0125f0 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc019070 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be8160d80 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0129d0 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.135+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be8152d10 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.137+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be8067be0 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.137+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bdc012b70 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.137+0000 7f7be4ff9640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7bd406c8f0 0x7f7bd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.137+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f7bdc08ba10 con 0x7f7be80b4810 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.137+0000 7f7be7fff640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7bd406c8f0 0x7f7bd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.138+0000 7f7be7fff640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7bd406c8f0 0x7f7bd406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8036000 tx=0x7f7bd803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.142+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7be8067be0 con 0x7f7be80b4810 2024-04-13T02:45:25.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.318+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7be8071b00 con 0x7f7be80b4810 2024-04-13T02:45:25.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.319+0000 7f7be4ff9640 1 -- 172.21.15.114:0/1448176349 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+12927 (secure 0 0 0) 0x7f7be8161c20 con 0x7f7be80b4810 2024-04-13T02:45:25.319 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:25.319 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":27,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:45:22.430710+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.320+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7bd406c8f0 msgr2=0x7f7bd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7bd406c8f0 0x7f7bd406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8036000 tx=0x7f7bd803c040 comp rx=0 tx=0).stop 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 msgr2=0x7f7be8156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 0x7f7be8156af0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00d5a0 tx=0x7f7bdc00da60 comp rx=0 tx=0).stop 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 shutdown_connections 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7be815ea70 0x7f7be80af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80b4810 0x7f7be8156af0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7bd406c8f0 0x7f7bd406edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 --2- 172.21.15.114:0/1448176349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7be80b12e0 0x7f7be8154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 >> 172.21.15.114:0/1448176349 conn(0x7f7be80b6f50 msgr2=0x7f7be8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 shutdown_connections 2024-04-13T02:45:25.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.321+0000 7f7bee636640 1 -- 172.21.15.114:0/1448176349 wait complete. 2024-04-13T02:45:25.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:25.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:25.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.435+0000 7f5a6cdc4640 1 Processor -- start 2024-04-13T02:45:25.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.435+0000 7f5a6cdc4640 1 -- start start 2024-04-13T02:45:25.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.436+0000 7f5a6cdc4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.436+0000 7f5a6cdc4640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5a680d1020 0x7f5a680cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.436+0000 7f5a6cdc4640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a6809b740 con 0x7f5a68072150 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.436+0000 7f5a6cdc4640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5a680cd4d0 con 0x7f5a680d1020 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.436+0000 7f5a6cdc4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5a680d3660 con 0x7f5a68160050 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a6659c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a66d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5a680d1020 0x7f5a680cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a65d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5a68072150 0x7f5a680d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:52238/0 (socket says 172.21.15.114:52238) 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a65d9b640 1 -- 172.21.15.114:0/2138446244 learned_addr learned my addr 172.21.15.114:0/2138446244 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a6659c640 1 --2- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:45480/0 (socket says 172.21.15.114:45480) 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a66d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5a680d1020 0x7f5a680cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:42528/0 (socket says 172.21.15.114:42528) 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a66d9d640 1 -- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 msgr2=0x7f5a68071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a66d9d640 1 --2- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a66d9d640 1 -- 172.21.15.114:0/2138446244 >> v1:172.21.15.130:6789/0 conn(0x7f5a68072150 legacy=0x7f5a680d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.437+0000 7f5a66d9d640 1 -- 172.21.15.114:0/2138446244 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a68160430 con 0x7f5a680d1020 2024-04-13T02:45:25.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.438+0000 7f5a66d9d640 1 --2- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a680d1020 0x7f5a680cd960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a580097a0 tx=0x7f5a5802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8487d97e5392abe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.438+0000 7f5a6559a640 1 -- 172.21.15.114:0/2138446244 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58038070 con 0x7f5a680d1020 2024-04-13T02:45:25.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.438+0000 7f5a6559a640 1 -- 172.21.15.114:0/2138446244 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a58031700 con 0x7f5a680d1020 2024-04-13T02:45:25.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.438+0000 7f5a6559a640 1 -- 172.21.15.114:0/2138446244 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58031ad0 con 0x7f5a680d1020 2024-04-13T02:45:25.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a680d1020 msgr2=0x7f5a680cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a680d1020 0x7f5a680cd960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a580097a0 tx=0x7f5a5802b7a0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2138446244 shutdown_connections 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a680d1020 0x7f5a680cd960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2138446244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2138446244 >> 172.21.15.114:0/2138446244 conn(0x7f5a680d2750 msgr2=0x7f5a680d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2138446244 shutdown_connections 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.439+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2138446244 wait complete. 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.440+0000 7f5a6cdc4640 1 Processor -- start 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.440+0000 7f5a6cdc4640 1 -- start start 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6cdc4640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a68072150 0x7f5a680b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6cdc4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 0x7f5a680b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6cdc4640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6cdc4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5a680cd0f0 con 0x7f5a680d1020 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6cdc4640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6809bcc0 con 0x7f5a68072150 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6cdc4640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5a680cdea0 con 0x7f5a68160050 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 0x7f5a680b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 0x7f5a680b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59318/0 (socket says 172.21.15.114:59318) 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 -- 172.21.15.114:0/2816571333 learned_addr learned my addr 172.21.15.114:0/2816571333 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a6659c640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a68072150 0x7f5a680b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a66d9d640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 -- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 msgr2=0x7f5a68156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 -- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a68072150 msgr2=0x7f5a680b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a68072150 0x7f5a680b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 -- 172.21.15.114:0/2816571333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a680b63f0 con 0x7f5a680d1020 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a66d9d640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.441+0000 7f5a65d9b640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 0x7f5a680b7f90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00cb10 tx=0x7f5a5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.442+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c017070 con 0x7f5a680d1020 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.442+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00ac70 con 0x7f5a680d1020 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.442+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a680caa80 con 0x7f5a680d1020 2024-04-13T02:45:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.442+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00ae60 con 0x7f5a680d1020 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.442+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a68156b90 con 0x7f5a680d1020 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.443+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a68068c80 con 0x7f5a680d1020 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.443+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a5c01a070 con 0x7f5a680d1020 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.443+0000 7f5a56ffd640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a4806c8f0 0x7f5a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.443+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f5a5c08b5b0 con 0x7f5a680d1020 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.443+0000 7f5a6659c640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a4806c8f0 0x7f5a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.444+0000 7f5a6659c640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a4806c8f0 0x7f5a4806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a6815be30 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.448+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a5c059d40 con 0x7f5a680d1020 2024-04-13T02:45:25.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.625+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5a6809b3a0 con 0x7f5a680d1020 2024-04-13T02:45:25.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.625+0000 7f5a56ffd640 1 -- 172.21.15.114:0/2816571333 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5a5c059640 con 0x7f5a680d1020 2024-04-13T02:45:25.626 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a4806c8f0 msgr2=0x7f5a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a4806c8f0 0x7f5a4806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a6815be30 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 msgr2=0x7f5a680b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 0x7f5a680b7f90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00cb10 tx=0x7f5a5c00a060 comp rx=0 tx=0).stop 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 shutdown_connections 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a4806c8f0 0x7f5a4806edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a68160050 0x7f5a68156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a680d1020 0x7f5a680b7f90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 --2- 172.21.15.114:0/2816571333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a68072150 0x7f5a680b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 >> 172.21.15.114:0/2816571333 conn(0x7f5a680d2750 msgr2=0x7f5a680d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 shutdown_connections 2024-04-13T02:45:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.627+0000 7f5a6cdc4640 1 -- 172.21.15.114:0/2816571333 wait complete. 2024-04-13T02:45:25.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-13T02:45:25.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.738+0000 7ff0afbe0640 1 Processor -- start 2024-04-13T02:45:25.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.738+0000 7ff0afbe0640 1 -- start start 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0afbe0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0a80b0550 0x7ff0a815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0afbe0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a815ddb0 0x7ff0a815e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0afbe0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a81604b0 con 0x7ff0a8073180 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0afbe0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a8160790 con 0x7ff0a80b0550 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0afbe0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a8160a70 con 0x7ff0a815ddb0 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0a80b0550 0x7ff0a815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0a80b0550 0x7ff0a815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59328/0 (socket says 172.21.15.114:59328) 2024-04-13T02:45:25.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 -- 172.21.15.114:0/1532830788 learned_addr learned my addr 172.21.15.114:0/1532830788 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ae17d640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a815ddb0 0x7ff0a815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 -- 172.21.15.114:0/1532830788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a815ddb0 msgr2=0x7ff0a815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a815ddb0 0x7ff0a815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 -- 172.21.15.114:0/1532830788 >> v1:172.21.15.130:6789/0 conn(0x7ff0a8073180 legacy=0x7ff0a8073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ad17b640 1 -- 172.21.15.114:0/1532830788 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a8160d50 con 0x7ff0a80b0550 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.739+0000 7ff0ae17d640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a815ddb0 0x7ff0a815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.740+0000 7ff0ad17b640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a80b0550 0x7ff0a815d870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff0980098a0 tx=0x7ff09802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fdf74692f54242 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.740+0000 7ff0ac97a640 1 -- 172.21.15.114:0/1532830788 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098035020 con 0x7ff0a80b0550 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.740+0000 7ff0ac97a640 1 -- 172.21.15.114:0/1532830788 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098031640 con 0x7ff0a80b0550 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.740+0000 7ff0ac97a640 1 -- 172.21.15.114:0/1532830788 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09802d040 con 0x7ff0a80b0550 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1532830788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a80b0550 msgr2=0x7ff0a815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a80b0550 0x7ff0a815d870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff0980098a0 tx=0x7ff09802b8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1532830788 shutdown_connections 2024-04-13T02:45:25.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a815ddb0 0x7ff0a815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1532830788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a80b0550 0x7ff0a815d870 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1532830788 >> 172.21.15.114:0/1532830788 conn(0x7ff0a806f860 msgr2=0x7ff0a8072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1532830788 shutdown_connections 2024-04-13T02:45:25.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.741+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1532830788 wait complete. 2024-04-13T02:45:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.742+0000 7ff0afbe0640 1 Processor -- start 2024-04-13T02:45:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.742+0000 7ff0afbe0640 1 -- start start 2024-04-13T02:45:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0afbe0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a8073180 0x7ff0a8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0afbe0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0a80b0550 0x7ff0a8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0afbe0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 0x7ff0a8158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0afbe0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a815a6a0 con 0x7ff0a815ddb0 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0afbe0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a815e780 con 0x7ff0a80b0550 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0afbe0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a813f1e0 con 0x7ff0a8073180 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 0x7ff0a8158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 0x7ff0a8158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59336/0 (socket says 172.21.15.114:59336) 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 -- 172.21.15.114:0/1899099479 learned_addr learned my addr 172.21.15.114:0/1899099479 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ad17b640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0a80b0550 0x7ff0a8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ad97c640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a8073180 0x7ff0a8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 -- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a8073180 msgr2=0x7ff0a8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a8073180 0x7ff0a8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 -- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0a80b0550 msgr2=0x7ff0a8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0a80b0550 0x7ff0a8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 -- 172.21.15.114:0/1899099479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a8153ec0 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ad17b640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0a80b0550 0x7ff0a8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ad97c640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a8073180 0x7ff0a8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.743+0000 7ff0ae17d640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 0x7ff0a8158c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c7c0 tx=0x7ff0a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.744+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0015020 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.744+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0004230 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.744+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a8142310 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.744+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007620 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.744+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a8155c60 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.745+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a8068c80 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.745+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0a0018020 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.745+0000 7ff09e7fc640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff08c06c8f0 0x7ff08c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.746+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff0a008b850 con 0x7ff0a815ddb0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.746+0000 7ff0ad97c640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff08c06c8f0 0x7ff08c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.746+0000 7ff0ad97c640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff08c06c8f0 0x7ff08c06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001d70 tx=0x7ff0a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.750+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0a001f020 con 0x7ff0a815ddb0 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.927+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff0a8067d20 con 0x7ff0a815ddb0 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.927+0000 7ff09e7fc640 1 -- 172.21.15.114:0/1899099479 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7ff0a005a090 con 0x7ff0a815ddb0 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-04-13T02:45:25.928 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-04-13T02:45:25.929 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:25.929 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff08c06c8f0 msgr2=0x7ff08c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff08c06c8f0 0x7ff08c06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001d70 tx=0x7ff0a4009040 comp rx=0 tx=0).stop 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 msgr2=0x7ff0a8158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 0x7ff0a8158c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c7c0 tx=0x7ff0a000cc80 comp rx=0 tx=0).stop 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 shutdown_connections 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a815ddb0 0x7ff0a8158c80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff0a80b0550 0x7ff0a8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff08c06c8f0 0x7ff08c06edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 --2- 172.21.15.114:0/1899099479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0a8073180 0x7ff0a8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 >> 172.21.15.114:0/1899099479 conn(0x7ff0a806f860 msgr2=0x7ff0a8073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 shutdown_connections 2024-04-13T02:45:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:25.929+0000 7ff0afbe0640 1 -- 172.21.15.114:0/1899099479 wait complete. 2024-04-13T02:45:25.940 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-13T02:45:25.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-13T02:45:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.044+0000 7f296c31e640 1 Processor -- start 2024-04-13T02:45:26.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.044+0000 7f296c31e640 1 -- start start 2024-04-13T02:45:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.045+0000 7f296c31e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f296415cb80 0x7f29640ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.045+0000 7f296c31e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f296409ab90 0x7f296409b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.045+0000 7f296c31e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29640d0b00 0x7f29640d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.045+0000 7f296c31e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f29640d18a0 con 0x7f296409ab90 2024-04-13T02:45:26.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.045+0000 7f296c31e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f29640cd380 con 0x7f296415cb80 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.045+0000 7f296c31e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f29640cd620 con 0x7f29640d0b00 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f296409ab90 0x7f296409b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f296409ab90 0x7f296409b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59352/0 (socket says 172.21.15.114:59352) 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 -- 172.21.15.114:0/443824721 learned_addr learned my addr 172.21.15.114:0/443824721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f296a8bb640 1 --2- 172.21.15.114:0/443824721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29640d0b00 0x7f29640d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f296a0ba640 1 --2- 172.21.15.114:0/443824721 >> v2:172.21.15.130:3300/0 conn(0x7f296415cb80 0x7f29640ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 -- 172.21.15.114:0/443824721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29640d0b00 msgr2=0x7f29640d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 --2- 172.21.15.114:0/443824721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29640d0b00 0x7f29640d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 -- 172.21.15.114:0/443824721 >> v2:172.21.15.130:3300/0 conn(0x7f296415cb80 msgr2=0x7f29640ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 --2- 172.21.15.114:0/443824721 >> v2:172.21.15.130:3300/0 conn(0x7f296415cb80 0x7f29640ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f29698b9640 1 -- 172.21.15.114:0/443824721 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29640cd900 con 0x7f296409ab90 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.046+0000 7f296a0ba640 1 --2- 172.21.15.114:0/443824721 >> v2:172.21.15.130:3300/0 conn(0x7f296415cb80 0x7f29640ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f29698b9640 1 --2- 172.21.15.114:0/443824721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f296409ab90 0x7f296409b020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2964068760 tx=0x7f296002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8bb615be9149e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f29690b8640 1 -- 172.21.15.114:0/443824721 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296002e070 con 0x7f296409ab90 2024-04-13T02:45:26.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f29690b8640 1 -- 172.21.15.114:0/443824721 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2960037070 con 0x7f296409ab90 2024-04-13T02:45:26.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f29690b8640 1 -- 172.21.15.114:0/443824721 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960031a00 con 0x7f296409ab90 2024-04-13T02:45:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 -- 172.21.15.114:0/443824721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f296409ab90 msgr2=0x7f296409b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 --2- 172.21.15.114:0/443824721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f296409ab90 0x7f296409b020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2964068760 tx=0x7f296002b880 comp rx=0 tx=0).stop 2024-04-13T02:45:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 -- 172.21.15.114:0/443824721 shutdown_connections 2024-04-13T02:45:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 --2- 172.21.15.114:0/443824721 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29640d0b00 0x7f29640d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 --2- 172.21.15.114:0/443824721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f296409ab90 0x7f296409b020 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 --2- 172.21.15.114:0/443824721 >> v2:172.21.15.130:3300/0 conn(0x7f296415cb80 0x7f29640ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 -- 172.21.15.114:0/443824721 >> 172.21.15.114:0/443824721 conn(0x7f29640d2870 msgr2=0x7f29640d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 -- 172.21.15.114:0/443824721 shutdown_connections 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.047+0000 7f296c31e640 1 -- 172.21.15.114:0/443824721 wait complete. 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.048+0000 7f296c31e640 1 Processor -- start 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 -- start start 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f296409ab90 0x7f296415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 0x7f29640b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f296415cb80 0x7f29641efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f296415cf60 con 0x7f29640d0b00 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f29640cdec0 con 0x7f296415cb80 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f296c31e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f29640d14d0 con 0x7f296409ab90 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f29698b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 0x7f29640b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f29698b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 0x7f29640b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59368/0 (socket says 172.21.15.114:59368) 2024-04-13T02:45:26.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.049+0000 7f29698b9640 1 -- 172.21.15.114:0/3765124051 learned_addr learned my addr 172.21.15.114:0/3765124051 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f29698b9640 1 -- 172.21.15.114:0/3765124051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f296409ab90 msgr2=0x7f296415d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f29698b9640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f296409ab90 0x7f296415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f29698b9640 1 -- 172.21.15.114:0/3765124051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f296415cb80 msgr2=0x7f29641efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f29698b9640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f296415cb80 0x7f29641efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f29698b9640 1 -- 172.21.15.114:0/3765124051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29640b6530 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f29698b9640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 0x7f29640b5ff0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f296002b8c0 tx=0x7f29600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960032670 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2960032810 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960032c00 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296415d7e0 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.050+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296415dda0 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.051+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2964068db0 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.051+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f296004c060 con 0x7f29640d0b00 2024-04-13T02:45:26.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.052+0000 7f295affd640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f294806c8f0 0x7f294806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.052+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f29600ad280 con 0x7f29640d0b00 2024-04-13T02:45:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.052+0000 7f296a0ba640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f294806c8f0 0x7f294806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.052+0000 7f296a0ba640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f294806c8f0 0x7f294806edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2954006fd0 tx=0x7f2954008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.056+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2960040070 con 0x7f29640d0b00 2024-04-13T02:45:26.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.231+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f29640d36a0 con 0x7f29640d0b00 2024-04-13T02:45:26.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.433+0000 7f295affd640 1 -- 172.21.15.114:0/3765124051 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7f296007ba90 con 0x7f29640d0b00 2024-04-13T02:45:26.433 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f294806c8f0 msgr2=0x7f294806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f294806c8f0 0x7f294806edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2954006fd0 tx=0x7f2954008040 comp rx=0 tx=0).stop 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 msgr2=0x7f29640b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 0x7f29640b5ff0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f296002b8c0 tx=0x7f29600046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 shutdown_connections 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f296415cb80 0x7f29641efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29640d0b00 0x7f29640b5ff0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f294806c8f0 0x7f294806edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 --2- 172.21.15.114:0/3765124051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f296409ab90 0x7f296415d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 >> 172.21.15.114:0/3765124051 conn(0x7f29640d2870 msgr2=0x7f29640afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 shutdown_connections 2024-04-13T02:45:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.435+0000 7f296c31e640 1 -- 172.21.15.114:0/3765124051 wait complete. 2024-04-13T02:45:26.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-13T02:45:26.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.556+0000 7fbd4fb88640 1 Processor -- start 2024-04-13T02:45:26.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.556+0000 7fbd4fb88640 1 -- start start 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4fb88640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbd480b54b0 0x7fbd480b5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4fb88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd4806f260 0x7fbd4806f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4fb88640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4806fbb0 con 0x7fbd48145170 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4fb88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbd48145550 con 0x7fbd4806f260 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4fb88640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fbd480b4410 con 0x7fbd480b54b0 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd4806f260 0x7fbd4806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd4806f260 0x7fbd4806f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59378/0 (socket says 172.21.15.114:59378) 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 -- 172.21.15.114:0/48799553 learned_addr learned my addr 172.21.15.114:0/48799553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4d924640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbd48145170 0x7fbd480cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41486/0 (socket says 172.21.15.114:41486) 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4d123640 1 --2- 172.21.15.114:0/48799553 >> v2:172.21.15.130:3300/0 conn(0x7fbd480b54b0 0x7fbd480b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 -- 172.21.15.114:0/48799553 >> v2:172.21.15.130:3300/0 conn(0x7fbd480b54b0 msgr2=0x7fbd480b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 --2- 172.21.15.114:0/48799553 >> v2:172.21.15.130:3300/0 conn(0x7fbd480b54b0 0x7fbd480b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 -- 172.21.15.114:0/48799553 >> v1:172.21.15.114:6789/0 conn(0x7fbd48145170 legacy=0x7fbd480cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4e125640 1 -- 172.21.15.114:0/48799553 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd480b46f0 con 0x7fbd4806f260 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.557+0000 7fbd4c922640 1 -- 172.21.15.114:0/48799553 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069544811 0 0) 0x7fbd44001110 con 0x7fbd48145170 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.558+0000 7fbd4e125640 1 --2- 172.21.15.114:0/48799553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd4806f670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbd480cd590 tx=0x7fbd4002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f950fdae836158a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.558+0000 7fbd4c922640 1 -- 172.21.15.114:0/48799553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4002cb20 con 0x7fbd4806f260 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.558+0000 7fbd4c922640 1 -- 172.21.15.114:0/48799553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4002ccc0 con 0x7fbd4806f260 2024-04-13T02:45:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.558+0000 7fbd4c922640 1 -- 172.21.15.114:0/48799553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40034610 con 0x7fbd4806f260 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 -- 172.21.15.114:0/48799553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 msgr2=0x7fbd4806f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/48799553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd4806f670 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbd480cd590 tx=0x7fbd4002bf80 comp rx=0 tx=0).stop 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 -- 172.21.15.114:0/48799553 shutdown_connections 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/48799553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd4806f670 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/48799553 >> v2:172.21.15.130:3300/0 conn(0x7fbd480b54b0 0x7fbd480b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 -- 172.21.15.114:0/48799553 >> 172.21.15.114:0/48799553 conn(0x7fbd480b2460 msgr2=0x7fbd480b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 -- 172.21.15.114:0/48799553 shutdown_connections 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.559+0000 7fbd4fb88640 1 -- 172.21.15.114:0/48799553 wait complete. 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.560+0000 7fbd4fb88640 1 Processor -- start 2024-04-13T02:45:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.560+0000 7fbd4fb88640 1 -- start start 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd481e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd480b54b0 0x7fbd4806e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd48145170 0x7fbd4806e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd480b4f90 con 0x7fbd4806f260 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd480b4cb0 con 0x7fbd480b54b0 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbd480ce240 con 0x7fbd48145170 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd481e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd481e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59384/0 (socket says 172.21.15.114:59384) 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 -- 172.21.15.114:0/358824553 learned_addr learned my addr 172.21.15.114:0/358824553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d123640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd480b54b0 0x7fbd4806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4e125640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd48145170 0x7fbd4806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 -- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd48145170 msgr2=0x7fbd4806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd48145170 0x7fbd4806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 -- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd480b54b0 msgr2=0x7fbd4806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd480b54b0 0x7fbd4806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 -- 172.21.15.114:0/358824553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4812dec0 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d123640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd480b54b0 0x7fbd4806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4d924640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd481e5710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c780 tx=0x7fbd4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44018070 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd440072d0 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd440047e0 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4812e1a0 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.561+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4812e760 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.562+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd48068c80 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.563+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd4401b070 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.563+0000 7fbd3e7fc640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd2c06c8f0 0x7fbd2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.563+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7fbd4408acc0 con 0x7fbd4806f260 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.563+0000 7fbd4d123640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd2c06c8f0 0x7fbd2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.564+0000 7fbd4d123640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd2c06c8f0 0x7fbd2c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd481e2450 tx=0x7fbd38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.568+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd4806fbb0 con 0x7fbd4806f260 2024-04-13T02:45:26.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:26.742+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbd480cdb80 con 0x7fbd4806f260 2024-04-13T02:45:27.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.440+0000 7fbd3e7fc640 1 -- 172.21.15.114:0/358824553 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7fbd440592d0 con 0x7fbd4806f260 2024-04-13T02:45:27.441 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd2c06c8f0 msgr2=0x7fbd2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd2c06c8f0 0x7fbd2c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd481e2450 tx=0x7fbd38008040 comp rx=0 tx=0).stop 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 msgr2=0x7fbd481e5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd481e5710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c780 tx=0x7fbd4400cc40 comp rx=0 tx=0).stop 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 shutdown_connections 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbd2c06c8f0 0x7fbd2c06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbd48145170 0x7fbd4806e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd480b54b0 0x7fbd4806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 --2- 172.21.15.114:0/358824553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4806f260 0x7fbd481e5710 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 >> 172.21.15.114:0/358824553 conn(0x7fbd480b2460 msgr2=0x7fbd481417e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.443+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 shutdown_connections 2024-04-13T02:45:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.444+0000 7fbd4fb88640 1 -- 172.21.15.114:0/358824553 wait complete. 2024-04-13T02:45:27.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-13T02:45:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.574+0000 7f58f36b7640 1 Processor -- start 2024-04-13T02:45:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f36b7640 1 -- start start 2024-04-13T02:45:27.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f36b7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58ec15ed60 0x7f58ec0ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:27.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f36b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d2b80 0x7f58ec0d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f36b7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ec0d4720 con 0x7f58ec0d18b0 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f36b7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f58ec0ba7b0 con 0x7f58ec15ed60 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f36b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f58ec0d3140 con 0x7f58ec0d2b80 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.575+0000 7f58f1453640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58ec15ed60 0x7f58ec0ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.576+0000 7f58f1453640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f58ec15ed60 0x7f58ec0ba270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59394/0 (socket says 172.21.15.114:59394) 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.576+0000 7f58f1453640 1 -- 172.21.15.114:0/3339289786 learned_addr learned my addr 172.21.15.114:0/3339289786 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.576+0000 7f58f1453640 1 -- 172.21.15.114:0/3339289786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d2b80 msgr2=0x7f58ec0d41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.576+0000 7f58f1453640 1 --2- 172.21.15.114:0/3339289786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d2b80 0x7f58ec0d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.576+0000 7f58f1453640 1 -- 172.21.15.114:0/3339289786 >> v1:172.21.15.130:6789/0 conn(0x7f58ec0d18b0 legacy=0x7f58ec0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.576+0000 7f58f1453640 1 -- 172.21.15.114:0/3339289786 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec0d3420 con 0x7f58ec15ed60 2024-04-13T02:45:27.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f1453640 1 --2- 172.21.15.114:0/3339289786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec0ba270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009870 tx=0x7f58e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d329f4b5825d060e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:27.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58e3fff640 1 -- 172.21.15.114:0/3339289786 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8035020 con 0x7f58ec15ed60 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58e3fff640 1 -- 172.21.15.114:0/3339289786 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e8031640 con 0x7f58ec15ed60 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58e3fff640 1 -- 172.21.15.114:0/3339289786 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e802d040 con 0x7f58ec15ed60 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 -- 172.21.15.114:0/3339289786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 msgr2=0x7f58ec0ba270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 --2- 172.21.15.114:0/3339289786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec0ba270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009870 tx=0x7f58e802b8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 -- 172.21.15.114:0/3339289786 shutdown_connections 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 --2- 172.21.15.114:0/3339289786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d2b80 0x7f58ec0d41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 --2- 172.21.15.114:0/3339289786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec0ba270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 -- 172.21.15.114:0/3339289786 >> 172.21.15.114:0/3339289786 conn(0x7f58ec06d3e0 msgr2=0x7f58ec06d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 -- 172.21.15.114:0/3339289786 shutdown_connections 2024-04-13T02:45:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.577+0000 7f58f36b7640 1 -- 172.21.15.114:0/3339289786 wait complete. 2024-04-13T02:45:27.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 Processor -- start 2024-04-13T02:45:27.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 -- start start 2024-04-13T02:45:27.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d18b0 0x7f58ec0b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58ec0d2b80 0x7f58ec15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0d3cc0 con 0x7f58ec15ed60 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0d39e0 con 0x7f58ec0d2b80 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f36b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f58ec15f140 con 0x7f58ec0d18b0 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f1c54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f1c54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec15bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59404/0 (socket says 172.21.15.114:59404) 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.579+0000 7f58f1c54640 1 -- 172.21.15.114:0/2880752702 learned_addr learned my addr 172.21.15.114:0/2880752702 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f0c52640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58ec0d2b80 0x7f58ec15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1453640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d18b0 0x7f58ec0b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1c54640 1 -- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d18b0 msgr2=0x7f58ec0b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1c54640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d18b0 0x7f58ec0b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1c54640 1 -- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58ec0d2b80 msgr2=0x7f58ec15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1c54640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58ec0d2b80 0x7f58ec15b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1c54640 1 -- 172.21.15.114:0/2880752702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec1557b0 con 0x7f58ec15ed60 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f0c52640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58ec0d2b80 0x7f58ec15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1453640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d18b0 0x7f58ec0b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f1c54640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec15bde0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b9a0 tx=0x7f58e400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4019070 con 0x7f58ec15ed60 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e400cba0 con 0x7f58ec15ed60 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4014440 con 0x7f58ec15ed60 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec155a90 con 0x7f58ec15ed60 2024-04-13T02:45:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.580+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec156050 con 0x7f58ec15ed60 2024-04-13T02:45:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.581+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec068c80 con 0x7f58ec15ed60 2024-04-13T02:45:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.582+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58e401c070 con 0x7f58ec15ed60 2024-04-13T02:45:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.582+0000 7f58e1ffb640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f58d006c8f0 0x7f58d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.582+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f58e408b710 con 0x7f58ec15ed60 2024-04-13T02:45:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.582+0000 7f58f1453640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f58d006c8f0 0x7f58d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.583+0000 7f58f1453640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f58d006c8f0 0x7f58d006edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58e8036000 tx=0x7f58e803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:27.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.587+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58e4059ba0 con 0x7f58ec15ed60 2024-04-13T02:45:27.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:27.798+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f58ec0ba460 con 0x7f58ec15ed60 2024-04-13T02:45:28.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.450+0000 7f58e1ffb640 1 -- 172.21.15.114:0/2880752702 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f58e40594a0 con 0x7f58ec15ed60 2024-04-13T02:45:28.451 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 4 and data pool 5 2024-04-13T02:45:28.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.455+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f58d006c8f0 msgr2=0x7f58d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.455+0000 7f58f36b7640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f58d006c8f0 0x7f58d006edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58e8036000 tx=0x7f58e803c040 comp rx=0 tx=0).stop 2024-04-13T02:45:28.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.455+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 msgr2=0x7f58ec15bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.455+0000 7f58f36b7640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec15bde0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b9a0 tx=0x7f58e400be60 comp rx=0 tx=0).stop 2024-04-13T02:45:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.456+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 shutdown_connections 2024-04-13T02:45:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.456+0000 7f58f36b7640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58ec15ed60 0x7f58ec15bde0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.456+0000 7f58f36b7640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58ec0d2b80 0x7f58ec15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.456+0000 7f58f36b7640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f58d006c8f0 0x7f58d006edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.456+0000 7f58f36b7640 1 --2- 172.21.15.114:0/2880752702 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ec0d18b0 0x7f58ec0b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.456+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 >> 172.21.15.114:0/2880752702 conn(0x7f58ec06d3e0 msgr2=0x7f58ec0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:28.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.461+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 shutdown_connections 2024-04-13T02:45:28.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.461+0000 7f58f36b7640 1 -- 172.21.15.114:0/2880752702 wait complete. 2024-04-13T02:45:28.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:28.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.582+0000 7f62f3974640 1 Processor -- start 2024-04-13T02:45:28.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.583+0000 7f62f3974640 1 -- start start 2024-04-13T02:45:28.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.583+0000 7f62f3974640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62ec071530 0x7f62ec09b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.583+0000 7f62f3974640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec0ce710 0x7f62ec0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.583+0000 7f62f3974640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ec0ccf40 con 0x7f62ec15ee40 2024-04-13T02:45:28.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.583+0000 7f62f3974640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f62ec09c140 con 0x7f62ec071530 2024-04-13T02:45:28.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.583+0000 7f62f3974640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec0d1e30 con 0x7f62ec0ce710 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62ec071530 0x7f62ec09b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62ec071530 0x7f62ec09b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59410/0 (socket says 172.21.15.114:59410) 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 -- 172.21.15.114:0/1459729643 learned_addr learned my addr 172.21.15.114:0/1459729643 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f1710640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f62ec15ee40 0x7f62ec070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41498/0 (socket says 172.21.15.114:41498) 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f1f11640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec0ce710 0x7f62ec0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 -- 172.21.15.114:0/1459729643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec0ce710 msgr2=0x7f62ec0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec0ce710 0x7f62ec0d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 -- 172.21.15.114:0/1459729643 >> v1:172.21.15.114:6789/0 conn(0x7f62ec15ee40 legacy=0x7f62ec070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f0f0f640 1 -- 172.21.15.114:0/1459729643 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec070920 con 0x7f62ec071530 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.584+0000 7f62f1f11640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec0ce710 0x7f62ec0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f0f0f640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec071530 0x7f62ec09b5a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009870 tx=0x7f62dc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6543845b5240836b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62e3fff640 1 -- 172.21.15.114:0/1459729643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0317c0 con 0x7f62ec071530 2024-04-13T02:45:28.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62e3fff640 1 -- 172.21.15.114:0/1459729643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc037070 con 0x7f62ec071530 2024-04-13T02:45:28.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62e3fff640 1 -- 172.21.15.114:0/1459729643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc031b80 con 0x7f62ec071530 2024-04-13T02:45:28.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 -- 172.21.15.114:0/1459729643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec071530 msgr2=0x7f62ec09b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec071530 0x7f62ec09b5a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009870 tx=0x7f62dc02b860 comp rx=0 tx=0).stop 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 -- 172.21.15.114:0/1459729643 shutdown_connections 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec0ce710 0x7f62ec0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 --2- 172.21.15.114:0/1459729643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec071530 0x7f62ec09b5a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 -- 172.21.15.114:0/1459729643 >> 172.21.15.114:0/1459729643 conn(0x7f62ec0d2750 msgr2=0x7f62ec0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 -- 172.21.15.114:0/1459729643 shutdown_connections 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.585+0000 7f62f3974640 1 -- 172.21.15.114:0/1459729643 wait complete. 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.586+0000 7f62f3974640 1 Processor -- start 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.586+0000 7f62f3974640 1 -- start start 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f3974640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec071530 0x7f62ec161d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f3974640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62ec0ce710 0x7f62ec1f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f3974640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 0x7f62ec1f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f3974640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec0cd1e0 con 0x7f62ec15ee40 2024-04-13T02:45:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f3974640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec09be60 con 0x7f62ec0ce710 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f3974640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f62ec0d0e20 con 0x7f62ec071530 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 0x7f62ec1f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 0x7f62ec1f8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59424/0 (socket says 172.21.15.114:59424) 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 -- 172.21.15.114:0/1466782648 learned_addr learned my addr 172.21.15.114:0/1466782648 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1710640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec071530 0x7f62ec161d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f0f0f640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62ec0ce710 0x7f62ec1f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 -- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec071530 msgr2=0x7f62ec161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec071530 0x7f62ec161d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 -- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62ec0ce710 msgr2=0x7f62ec1f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62ec0ce710 0x7f62ec1f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.587+0000 7f62f1f11640 1 -- 172.21.15.114:0/1466782648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec15c610 con 0x7f62ec15ee40 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.588+0000 7f62f1f11640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 0x7f62ec1f8400 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c820 tx=0x7f62e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.588+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4015070 con 0x7f62ec15ee40 2024-04-13T02:45:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.588+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4007a30 con 0x7f62ec15ee40 2024-04-13T02:45:28.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.588+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec160860 con 0x7f62ec15ee40 2024-04-13T02:45:28.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.588+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4007e20 con 0x7f62ec15ee40 2024-04-13T02:45:28.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.588+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec15faa0 con 0x7f62ec15ee40 2024-04-13T02:45:28.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.589+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ec068c60 con 0x7f62ec15ee40 2024-04-13T02:45:28.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.589+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62e4018070 con 0x7f62ec15ee40 2024-04-13T02:45:28.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.590+0000 7f62e1ffb640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f62d006c8f0 0x7f62d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.590+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f62e408b9f0 con 0x7f62ec15ee40 2024-04-13T02:45:28.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.590+0000 7f62f1710640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f62d006c8f0 0x7f62d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.590+0000 7f62f1710640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f62d006c8f0 0x7f62d006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62e80012e0 tx=0x7f62e8005b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.594+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62e4059eb0 con 0x7f62ec15ee40 2024-04-13T02:45:28.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.771+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62ec071b40 con 0x7f62ec15ee40 2024-04-13T02:45:28.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.772+0000 7f62e1ffb640 1 -- 172.21.15.114:0/1466782648 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f62e40597b0 con 0x7f62ec15ee40 2024-04-13T02:45:28.773 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:28.773 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:45:27.799591+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:28.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f62d006c8f0 msgr2=0x7f62d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f62d006c8f0 0x7f62d006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62e80012e0 tx=0x7f62e8005b70 comp rx=0 tx=0).stop 2024-04-13T02:45:28.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 msgr2=0x7f62ec1f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 0x7f62ec1f8400 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c820 tx=0x7f62e400cce0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 shutdown_connections 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62ec15ee40 0x7f62ec1f8400 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f62ec0ce710 0x7f62ec1f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f62d006c8f0 0x7f62d006edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 --2- 172.21.15.114:0/1466782648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f62ec071530 0x7f62ec161d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 >> 172.21.15.114:0/1466782648 conn(0x7f62ec0d2750 msgr2=0x7f62ec06e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 shutdown_connections 2024-04-13T02:45:28.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.774+0000 7f62f3974640 1 -- 172.21.15.114:0/1466782648 wait complete. 2024-04-13T02:45:28.786 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:28.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.886+0000 7f15ed46d640 1 Processor -- start 2024-04-13T02:45:28.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.886+0000 7f15ed46d640 1 -- start start 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15ed46d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15e815ef90 0x7f15e81677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15ed46d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e81604b0 con 0x7f15e80b0550 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15ed46d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e8160790 con 0x7f15e8073180 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15ed46d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f15e8160a70 con 0x7f15e815ef90 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e67fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f15e80b0550 0x7f15e815d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44860/0 (socket says 172.21.15.114:44860) 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e67fc640 1 -- 172.21.15.114:0/760423466 learned_addr learned my addr 172.21.15.114:0/760423466 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e77fe640 1 --2- 172.21.15.114:0/760423466 >> v2:172.21.15.130:3300/0 conn(0x7f15e815ef90 0x7f15e81677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348789796 0 0) 0x7f15e81604b0 con 0x7f15e80b0550 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d0003520 con 0x7f15e80b0550 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624172425 0 0) 0x7f15e8160790 con 0x7f15e8073180 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.887+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e81604b0 con 0x7f15e8073180 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1490994287 0 0) 0x7f15d0003520 con 0x7f15e80b0550 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 >> v2:172.21.15.130:3300/0 conn(0x7f15e815ef90 msgr2=0x7f15e81677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 --2- 172.21.15.114:0/760423466 >> v2:172.21.15.130:3300/0 conn(0x7f15e815ef90 0x7f15e81677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 >> v1:172.21.15.130:6789/0 conn(0x7f15e8073180 legacy=0x7f15e8073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e8160d50 con 0x7f15e80b0550 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f15dc001670 con 0x7f15e80b0550 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 --2- 172.21.15.114:0/760423466 >> v2:172.21.15.130:3300/0 conn(0x7f15e815ef90 0x7f15e81677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 >> v1:172.21.15.114:6789/0 conn(0x7f15e80b0550 legacy=0x7f15e815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d0003b40 0x7f15d0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d0004800 0x7f15d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15d00051c0 0x7f15d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f15e8160a70 con 0x7f15d00051c0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15d000c0f0 con 0x7f15d0003b40 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f15d000c2f0 con 0x7f15d0004800 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15d00051c0 0x7f15d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e6ffd640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d0003b40 0x7f15d0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e67fc640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d0004800 0x7f15d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 -- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d0004800 msgr2=0x7f15d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d0004800 0x7f15d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 -- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d0003b40 msgr2=0x7f15d0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d0003b40 0x7f15d0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.888+0000 7f15e77fe640 1 -- 172.21.15.114:0/760423466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d0003520 con 0x7f15d00051c0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15e77fe640 1 -- 172.21.15.114:0/760423466 reap_dead start 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15e77fe640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15d00051c0 0x7f15d000b9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f15e000e350 tx=0x7f15d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85270d0f79259ac server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0039070 con 0x7f15d00051c0 2024-04-13T02:45:28.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e002ce20 con 0x7f15d00051c0 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15e5ffb640 1 -- 172.21.15.114:0/760423466 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0009de0 con 0x7f15d00051c0 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15ed46d640 1 -- 172.21.15.114:0/760423466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15d00051c0 msgr2=0x7f15d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15ed46d640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15d00051c0 0x7f15d000b9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f15e000e350 tx=0x7f15d0005830 comp rx=0 tx=0).stop 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15ed46d640 1 -- 172.21.15.114:0/760423466 shutdown_connections 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15ed46d640 1 --2- 172.21.15.114:0/760423466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15d00051c0 0x7f15d000b9c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.889+0000 7f15ed46d640 1 -- 172.21.15.114:0/760423466 >> 172.21.15.114:0/760423466 conn(0x7f15e806f860 msgr2=0x7f15e8072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.890+0000 7f15ed46d640 1 -- 172.21.15.114:0/760423466 shutdown_connections 2024-04-13T02:45:28.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.890+0000 7f15ed46d640 1 -- 172.21.15.114:0/760423466 wait complete. 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.891+0000 7f15ed46d640 1 Processor -- start 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.891+0000 7f15ed46d640 1 -- start start 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d00051c0 0x7f15e81556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 0x7f15e8145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15e81573a0 0x7f15e8157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f15e815a6a0 con 0x7f15e81f27f0 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15e8073560 con 0x7f15d00051c0 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f15e80a9720 con 0x7f15e81573a0 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 0x7f15e8145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 0x7f15e8145910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43074/0 (socket says 172.21.15.114:43074) 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 -- 172.21.15.114:0/3645383700 learned_addr learned my addr 172.21.15.114:0/3645383700 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:28.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e6ffd640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d00051c0 0x7f15e81556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e77fe640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15e81573a0 0x7f15e8157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 -- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15e81573a0 msgr2=0x7f15e8157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15e81573a0 0x7f15e8157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 -- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d00051c0 msgr2=0x7f15e81556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d00051c0 0x7f15e81556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 -- 172.21.15.114:0/3645383700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e81f2fd0 con 0x7f15e81f27f0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e77fe640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15e81573a0 0x7f15e8157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15e67fc640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 0x7f15e8145910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f15dc004ee0 tx=0x7f15dc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00f7b0 con 0x7f15e81f27f0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15dc018070 con 0x7f15e81f27f0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e81f32b0 con 0x7f15e81f27f0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00fbd0 con 0x7f15e81f27f0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.892+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e8145e50 con 0x7f15e81f27f0 2024-04-13T02:45:28.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.893+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e8068c80 con 0x7f15e81f27f0 2024-04-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.894+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15dc01d460 con 0x7f15e81f27f0 2024-04-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.894+0000 7f15cf7fe640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f15d406c920 0x7f15d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.894+0000 7f15e6ffd640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f15d406c920 0x7f15d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.894+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f15dc08ba10 con 0x7f15e81f27f0 2024-04-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.895+0000 7f15e6ffd640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f15d406c920 0x7f15d406ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15e80b0420 tx=0x7f15d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:28.899+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15dc059ed0 con 0x7f15e81f27f0 2024-04-13T02:45:29.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.075+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15e8067d20 con 0x7f15e81f27f0 2024-04-13T02:45:29.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.076+0000 7f15cf7fe640 1 -- 172.21.15.114:0/3645383700 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f15dc0597d0 con 0x7f15e81f27f0 2024-04-13T02:45:29.077 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:29.077 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:45:27.799591+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:29.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f15d406c920 msgr2=0x7f15d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f15d406c920 0x7f15d406ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15e80b0420 tx=0x7f15d8009040 comp rx=0 tx=0).stop 2024-04-13T02:45:29.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 msgr2=0x7f15e8145910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 0x7f15e8145910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f15dc004ee0 tx=0x7f15dc007430 comp rx=0 tx=0).stop 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 shutdown_connections 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f15d406c920 0x7f15d406ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15e81573a0 0x7f15e8157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15e81f27f0 0x7f15e8145910 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 --2- 172.21.15.114:0/3645383700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15d00051c0 0x7f15e81556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 >> 172.21.15.114:0/3645383700 conn(0x7f15e806f860 msgr2=0x7f15e80b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 shutdown_connections 2024-04-13T02:45:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.078+0000 7f15ed46d640 1 -- 172.21.15.114:0/3645383700 wait complete. 2024-04-13T02:45:29.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-13T02:45:29.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.193+0000 7fddbfc08640 1 Processor -- start 2024-04-13T02:45:29.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.193+0000 7fddbfc08640 1 -- start start 2024-04-13T02:45:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.193+0000 7fddbfc08640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fddb8067a40 0x7fddb80b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbfc08640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddb80b6150 0x7fddb806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbfc08640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb80b41f0 con 0x7fddb80b5830 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbfc08640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fddb815f390 con 0x7fddb80b6150 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbfc08640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fddb80b4e00 con 0x7fddb8067a40 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddb80b6150 0x7fddb806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddb80b6150 0x7fddb806b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43090/0 (socket says 172.21.15.114:43090) 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 -- 172.21.15.114:0/4088822306 learned_addr learned my addr 172.21.15.114:0/4088822306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 -- 172.21.15.114:0/4088822306 >> v2:172.21.15.130:3300/0 conn(0x7fddb8067a40 msgr2=0x7fddb80b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbd1a3640 1 --2- 172.21.15.114:0/4088822306 >> v2:172.21.15.130:3300/0 conn(0x7fddb8067a40 0x7fddb80b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 --2- 172.21.15.114:0/4088822306 >> v2:172.21.15.130:3300/0 conn(0x7fddb8067a40 0x7fddb80b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 -- 172.21.15.114:0/4088822306 >> v1:172.21.15.130:6789/0 conn(0x7fddb80b5830 legacy=0x7fddb815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.194+0000 7fddbe1a5640 1 -- 172.21.15.114:0/4088822306 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb80b44d0 con 0x7fddb80b6150 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbe1a5640 1 --2- 172.21.15.114:0/4088822306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb80b6150 0x7fddb806b9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fddb81636a0 tx=0x7fddb002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff6fd28e0f5018b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbc9a2640 1 -- 172.21.15.114:0/4088822306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb002ca80 con 0x7fddb80b6150 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbc9a2640 1 -- 172.21.15.114:0/4088822306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb002cc20 con 0x7fddb80b6150 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbc9a2640 1 -- 172.21.15.114:0/4088822306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb00343f0 con 0x7fddb80b6150 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbfc08640 1 -- 172.21.15.114:0/4088822306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb80b6150 msgr2=0x7fddb806b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbfc08640 1 --2- 172.21.15.114:0/4088822306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb80b6150 0x7fddb806b9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fddb81636a0 tx=0x7fddb002bee0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbfc08640 1 -- 172.21.15.114:0/4088822306 shutdown_connections 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbfc08640 1 --2- 172.21.15.114:0/4088822306 >> v2:172.21.15.130:3300/0 conn(0x7fddb8067a40 0x7fddb80b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbfc08640 1 --2- 172.21.15.114:0/4088822306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb80b6150 0x7fddb806b9c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.195+0000 7fddbfc08640 1 -- 172.21.15.114:0/4088822306 >> 172.21.15.114:0/4088822306 conn(0x7fddb806ea10 msgr2=0x7fddb806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.196+0000 7fddbfc08640 1 -- 172.21.15.114:0/4088822306 shutdown_connections 2024-04-13T02:45:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.196+0000 7fddbfc08640 1 -- 172.21.15.114:0/4088822306 wait complete. 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 Processor -- start 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 -- start start 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 0x7fddb814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb80b5830 0x7fddb80cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb80b6150 0x7fddb80d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddb806bf00 con 0x7fddb8067a40 2024-04-13T02:45:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fddb80b4a90 con 0x7fddb80b6150 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbfc08640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fddb806c080 con 0x7fddb80b5830 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.197+0000 7fddbd9a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 0x7fddb814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 0x7fddb814f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43100/0 (socket says 172.21.15.114:43100) 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 -- 172.21.15.114:0/1409936359 learned_addr learned my addr 172.21.15.114:0/1409936359 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbe1a5640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb80b6150 0x7fddb80d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd1a3640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb80b5830 0x7fddb80cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 -- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb80b5830 msgr2=0x7fddb80cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb80b5830 0x7fddb80cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 -- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb80b6150 msgr2=0x7fddb80d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb80b6150 0x7fddb80d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 -- 172.21.15.114:0/1409936359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb814fb20 con 0x7fddb8067a40 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd1a3640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb80b5830 0x7fddb80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbd9a4640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 0x7fddb814f340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c430 tx=0x7fddb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4011790 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4017070 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4011b70 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb815d350 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.198+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb814fd90 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.199+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb8068c80 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.199+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddb4011d10 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.200+0000 7fddae7fc640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd9c06c8f0 0x7fdd9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.200+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fddb408b9a0 con 0x7fddb8067a40 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.200+0000 7fddbd1a3640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd9c06c8f0 0x7fdd9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.200+0000 7fddbd1a3640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd9c06c8f0 0x7fdd9c06edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fddb80c9fe0 tx=0x7fdda8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:29.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.204+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fddb815d350 con 0x7fddb8067a40 2024-04-13T02:45:29.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.416+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fddb80b5cb0 con 0x7fddb8067a40 2024-04-13T02:45:29.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.451+0000 7fddae7fc640 1 -- 172.21.15.114:0/1409936359 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7fddb4059dd0 con 0x7fddb8067a40 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd9c06c8f0 msgr2=0x7fdd9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd9c06c8f0 0x7fdd9c06edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fddb80c9fe0 tx=0x7fdda8008040 comp rx=0 tx=0).stop 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 msgr2=0x7fddb814f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 0x7fddb814f340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c430 tx=0x7fddb400c8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 shutdown_connections 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb80b6150 0x7fddb80d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdd9c06c8f0 0x7fdd9c06edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb80b5830 0x7fddb80cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 --2- 172.21.15.114:0/1409936359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb8067a40 0x7fddb814f340 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 >> 172.21.15.114:0/1409936359 conn(0x7fddb806ea10 msgr2=0x7fddb80aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:29.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 shutdown_connections 2024-04-13T02:45:29.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.453+0000 7fddbfc08640 1 -- 172.21.15.114:0/1409936359 wait complete. 2024-04-13T02:45:29.465 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-13T02:45:29.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-13T02:45:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.568+0000 7fbf409bb640 1 Processor -- start 2024-04-13T02:45:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.568+0000 7fbf409bb640 1 -- start start 2024-04-13T02:45:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf409bb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbf3c0b3720 0x7fbf3c0b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf409bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbf3c0b3c70 0x7fbf3c0b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf409bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf3c0ba4d0 con 0x7fbf3c15ecc0 2024-04-13T02:45:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf409bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3c15f0a0 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf409bb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fbf3c0ba280 con 0x7fbf3c0b3720 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3a59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbf3c15ecc0 0x7fbf3c0d2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44874/0 (socket says 172.21.15.114:44874) 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3a59c640 1 -- 172.21.15.114:0/4109341599 learned_addr learned my addr 172.21.15.114:0/4109341599 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3ad9d640 1 --2- 172.21.15.114:0/4109341599 >> v2:172.21.15.114:3300/0 conn(0x7fbf3c0b3c70 0x7fbf3c0b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf39d9b640 1 --2- 172.21.15.114:0/4109341599 >> v2:172.21.15.130:3300/0 conn(0x7fbf3c0b3720 0x7fbf3c0b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3ad9d640 1 -- 172.21.15.114:0/4109341599 >> v2:172.21.15.130:3300/0 conn(0x7fbf3c0b3720 msgr2=0x7fbf3c0b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3ad9d640 1 --2- 172.21.15.114:0/4109341599 >> v2:172.21.15.130:3300/0 conn(0x7fbf3c0b3720 0x7fbf3c0b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3ad9d640 1 -- 172.21.15.114:0/4109341599 >> v1:172.21.15.114:6789/0 conn(0x7fbf3c15ecc0 legacy=0x7fbf3c0d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3ad9d640 1 -- 172.21.15.114:0/4109341599 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c0ba7b0 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf3959a640 1 -- 172.21.15.114:0/4109341599 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544908400 0 0) 0x7fbf3c0ba4d0 con 0x7fbf3c15ecc0 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.569+0000 7fbf39d9b640 1 --2- 172.21.15.114:0/4109341599 >> v2:172.21.15.130:3300/0 conn(0x7fbf3c0b3720 0x7fbf3c0b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.570+0000 7fbf3ad9d640 1 --2- 172.21.15.114:0/4109341599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c0b9b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0b6f60 tx=0x7fbf3402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c202f6a49914d08c server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.570+0000 7fbf3959a640 1 -- 172.21.15.114:0/4109341599 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34039070 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.570+0000 7fbf3959a640 1 -- 172.21.15.114:0/4109341599 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3402cc80 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.570+0000 7fbf3959a640 1 -- 172.21.15.114:0/4109341599 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34034660 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 -- 172.21.15.114:0/4109341599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 msgr2=0x7fbf3c0b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 --2- 172.21.15.114:0/4109341599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c0b9b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0b6f60 tx=0x7fbf3402bed0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 -- 172.21.15.114:0/4109341599 shutdown_connections 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 --2- 172.21.15.114:0/4109341599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c0b9b30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 --2- 172.21.15.114:0/4109341599 >> v2:172.21.15.130:3300/0 conn(0x7fbf3c0b3720 0x7fbf3c0b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 -- 172.21.15.114:0/4109341599 >> 172.21.15.114:0/4109341599 conn(0x7fbf3c073480 msgr2=0x7fbf3c073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 -- 172.21.15.114:0/4109341599 shutdown_connections 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.571+0000 7fbf409bb640 1 -- 172.21.15.114:0/4109341599 wait complete. 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.572+0000 7fbf409bb640 1 Processor -- start 2024-04-13T02:45:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.572+0000 7fbf409bb640 1 -- start start 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbf3c0b3720 0x7fbf3c0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c1f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf3c15ecc0 0x7fbf3c0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c0b8aa0 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c0b90d0 con 0x7fbf3c15ecc0 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c0d3440 con 0x7fbf3c0b3720 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c1f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c1f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43114/0 (socket says 172.21.15.114:43114) 2024-04-13T02:45:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 -- 172.21.15.114:0/1262222609 learned_addr learned my addr 172.21.15.114:0/1262222609 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf3ad9d640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf3c15ecc0 0x7fbf3c0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf3a59c640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbf3c0b3720 0x7fbf3c0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 -- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbf3c0b3720 msgr2=0x7fbf3c0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbf3c0b3720 0x7fbf3c0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 -- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf3c15ecc0 msgr2=0x7fbf3c0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf3c15ecc0 0x7fbf3c0c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 -- 172.21.15.114:0/1262222609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c0c8db0 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf3a59c640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbf3c0b3720 0x7fbf3c0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf39d9b640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c1f4380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c820 tx=0x7fbf3000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30015070 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf30007a30 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30007e00 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.573+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c0c9090 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.574+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c0c9930 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.574+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c0c9260 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.575+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf30018070 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.575+0000 7fbf2affd640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbf1c06c920 0x7fbf1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.575+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbf3008baa0 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.575+0000 7fbf3a59c640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbf1c06c920 0x7fbf1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.576+0000 7fbf3a59c640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbf1c06c920 0x7fbf1c06ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c000f60 tx=0x7fbf2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.580+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf30059ed0 con 0x7fbf3c0b3c70 2024-04-13T02:45:29.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:29.796+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbf3c068c80 con 0x7fbf3c0b3c70 2024-04-13T02:45:30.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.458+0000 7fbf2affd640 1 -- 172.21.15.114:0/1262222609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7fbf300597d0 con 0x7fbf3c0b3c70 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbf1c06c920 msgr2=0x7fbf1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbf1c06c920 0x7fbf1c06ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c000f60 tx=0x7fbf2c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 msgr2=0x7fbf3c1f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c1f4380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c820 tx=0x7fbf3000cc20 comp rx=0 tx=0).stop 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 shutdown_connections 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf3c15ecc0 0x7fbf3c0c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf3c0b3c70 0x7fbf3c1f4380 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fbf1c06c920 0x7fbf1c06ede0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 --2- 172.21.15.114:0/1262222609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbf3c0b3720 0x7fbf3c0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 >> 172.21.15.114:0/1262222609 conn(0x7fbf3c073480 msgr2=0x7fbf3c0b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:30.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 shutdown_connections 2024-04-13T02:45:30.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.461+0000 7fbf409bb640 1 -- 172.21.15.114:0/1262222609 wait complete. 2024-04-13T02:45:30.474 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-13T02:45:30.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:30.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.576+0000 7f026622d640 1 Processor -- start 2024-04-13T02:45:30.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.576+0000 7f026622d640 1 -- start start 2024-04-13T02:45:30.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.576+0000 7f026622d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f026015c170 0x7f0260072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.576+0000 7f026622d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02601556c0 0x7f0260072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f026622d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02600b48e0 con 0x7f02601552e0 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f026622d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f02600b38d0 con 0x7f026015c170 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f026622d640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f02600b0270 con 0x7f02601556c0 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f0256ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f026015c170 0x7f0260072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f025f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f02601552e0 0x7f02600afb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44880/0 (socket says 172.21.15.114:44880) 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f025f7fe640 1 -- 172.21.15.114:0/2895702182 learned_addr learned my addr 172.21.15.114:0/2895702182 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f025ffff640 1 --2- 172.21.15.114:0/2895702182 >> v2:172.21.15.130:3300/0 conn(0x7f02601556c0 0x7f0260072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f0256ffd640 1 -- 172.21.15.114:0/2895702182 >> v2:172.21.15.130:3300/0 conn(0x7f02601556c0 msgr2=0x7f0260072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f0256ffd640 1 --2- 172.21.15.114:0/2895702182 >> v2:172.21.15.130:3300/0 conn(0x7f02601556c0 0x7f0260072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f0256ffd640 1 -- 172.21.15.114:0/2895702182 >> v1:172.21.15.114:6789/0 conn(0x7f02601552e0 legacy=0x7f02600afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f0256ffd640 1 -- 172.21.15.114:0/2895702182 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02600b3b20 con 0x7f026015c170 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.577+0000 7f025effd640 1 -- 172.21.15.114:0/2895702182 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966128164 0 0) 0x7f02600b48e0 con 0x7f02601552e0 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f0256ffd640 1 --2- 172.21.15.114:0/2895702182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026015c170 0x7f0260072a70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f02600ce860 tx=0x7f024802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed1262d0f00d084 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f025effd640 1 -- 172.21.15.114:0/2895702182 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248035020 con 0x7f026015c170 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f025effd640 1 -- 172.21.15.114:0/2895702182 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0248031830 con 0x7f026015c170 2024-04-13T02:45:30.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f025effd640 1 -- 172.21.15.114:0/2895702182 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248031c00 con 0x7f026015c170 2024-04-13T02:45:30.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 -- 172.21.15.114:0/2895702182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026015c170 msgr2=0x7f0260072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 --2- 172.21.15.114:0/2895702182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026015c170 0x7f0260072a70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f02600ce860 tx=0x7f024802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 -- 172.21.15.114:0/2895702182 shutdown_connections 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 --2- 172.21.15.114:0/2895702182 >> v2:172.21.15.130:3300/0 conn(0x7f02601556c0 0x7f0260072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 --2- 172.21.15.114:0/2895702182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026015c170 0x7f0260072a70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 -- 172.21.15.114:0/2895702182 >> 172.21.15.114:0/2895702182 conn(0x7f02600b27b0 msgr2=0x7f02600b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 -- 172.21.15.114:0/2895702182 shutdown_connections 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.578+0000 7f026622d640 1 -- 172.21.15.114:0/2895702182 wait complete. 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.579+0000 7f026622d640 1 Processor -- start 2024-04-13T02:45:30.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 -- start start 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 0x7f026015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02601556c0 0x7f0260149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c170 0x7f026014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f02600b43c0 con 0x7f02601552e0 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02600b40e0 con 0x7f02601556c0 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f026622d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02600d0110 con 0x7f026015c170 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.580+0000 7f025f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 0x7f026015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 0x7f026015d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43134/0 (socket says 172.21.15.114:43134) 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 -- 172.21.15.114:0/356757525 learned_addr learned my addr 172.21.15.114:0/356757525 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f0256ffd640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02601556c0 0x7f0260149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 -- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c170 msgr2=0x7f026014a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c170 0x7f026014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 -- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02601556c0 msgr2=0x7f0260149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02601556c0 0x7f0260149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 -- 172.21.15.114:0/356757525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0260150520 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f0256ffd640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02601556c0 0x7f0260149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025f7fe640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 0x7f026015d490 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f025000c4d0 tx=0x7f025000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250018070 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0250007500 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250004a20 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026014a970 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.581+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026014af30 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.582+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026014b270 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.583+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0250004bc0 con 0x7f02601552e0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.583+0000 7f025cff9640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f024006c8f0 0x7f024006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.583+0000 7f0256ffd640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f024006c8f0 0x7f024006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.583+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f025008ad70 con 0x7f02601552e0 2024-04-13T02:45:30.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.583+0000 7f0256ffd640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f024006c8f0 0x7f024006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0248036000 tx=0x7f0248008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.588+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f026014b270 con 0x7f02601552e0 2024-04-13T02:45:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.799+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02600b56d0 con 0x7f02601552e0 2024-04-13T02:45:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.800+0000 7f025cff9640 1 -- 172.21.15.114:0/356757525 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f0260150520 con 0x7f02601552e0 2024-04-13T02:45:30.800 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:30.801 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:29.798058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f024006c8f0 msgr2=0x7f024006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f024006c8f0 0x7f024006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0248036000 tx=0x7f0248008030 comp rx=0 tx=0).stop 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 msgr2=0x7f026015d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 0x7f026015d490 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f025000c4d0 tx=0x7f025000c990 comp rx=0 tx=0).stop 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 shutdown_connections 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f024006c8f0 0x7f024006edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f026015c170 0x7f026014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02601556c0 0x7f0260149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 --2- 172.21.15.114:0/356757525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02601552e0 0x7f026015d490 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.801+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 >> 172.21.15.114:0/356757525 conn(0x7f02600b27b0 msgr2=0x7f02600afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.802+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 shutdown_connections 2024-04-13T02:45:30.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.802+0000 7f026622d640 1 -- 172.21.15.114:0/356757525 wait complete. 2024-04-13T02:45:30.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:30.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.912+0000 7ff2c1c95640 1 Processor -- start 2024-04-13T02:45:30.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.912+0000 7ff2c1c95640 1 -- start start 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2c1c95640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2bc1461f0 0x7ff2bc0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2c1c95640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2bc0b3fe0 0x7ff2bc15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2c1c95640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0b4be0 con 0x7ff2bc0cedf0 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2c1c95640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc0a9640 con 0x7ff2bc1461f0 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2c1c95640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc0cf250 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2bb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2bc1461f0 0x7ff2bc0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2baffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2bc0cedf0 0x7ff2bc0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44894/0 (socket says 172.21.15.114:44894) 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2baffd640 1 -- 172.21.15.114:0/401173637 learned_addr learned my addr 172.21.15.114:0/401173637 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2bbfff640 1 --2- 172.21.15.114:0/401173637 >> v2:172.21.15.130:3300/0 conn(0x7ff2bc0b3fe0 0x7ff2bc15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/401173637 >> v2:172.21.15.130:3300/0 conn(0x7ff2bc0b3fe0 msgr2=0x7ff2bc15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.913+0000 7ff2bb7fe640 1 --2- 172.21.15.114:0/401173637 >> v2:172.21.15.130:3300/0 conn(0x7ff2bc0b3fe0 0x7ff2bc15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/401173637 >> v1:172.21.15.114:6789/0 conn(0x7ff2bc0cedf0 legacy=0x7ff2bc0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2ba7fc640 1 -- 172.21.15.114:0/401173637 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255309778 0 0) 0x7ff2bc0b4be0 con 0x7ff2bc0cedf0 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/401173637 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0b4620 con 0x7ff2bc1461f0 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2bb7fe640 1 --2- 172.21.15.114:0/401173637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc1461f0 0x7ff2bc0ce8b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0cf9a0 tx=0x7ff2ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4766bc813629d020 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2ba7fc640 1 -- 172.21.15.114:0/401173637 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac035020 con 0x7ff2bc1461f0 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2ba7fc640 1 -- 172.21.15.114:0/401173637 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac031830 con 0x7ff2bc1461f0 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.914+0000 7ff2ba7fc640 1 -- 172.21.15.114:0/401173637 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac031c00 con 0x7ff2bc1461f0 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 -- 172.21.15.114:0/401173637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc1461f0 msgr2=0x7ff2bc0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/401173637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc1461f0 0x7ff2bc0ce8b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0cf9a0 tx=0x7ff2ac02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 -- 172.21.15.114:0/401173637 shutdown_connections 2024-04-13T02:45:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/401173637 >> v2:172.21.15.130:3300/0 conn(0x7ff2bc0b3fe0 0x7ff2bc15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/401173637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc1461f0 0x7ff2bc0ce8b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 -- 172.21.15.114:0/401173637 >> 172.21.15.114:0/401173637 conn(0x7ff2bc0b27b0 msgr2=0x7ff2bc0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 -- 172.21.15.114:0/401173637 shutdown_connections 2024-04-13T02:45:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.915+0000 7ff2c1c95640 1 -- 172.21.15.114:0/401173637 wait complete. 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.916+0000 7ff2c1c95640 1 Processor -- start 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.916+0000 7ff2c1c95640 1 -- start start 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2c1c95640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 0x7ff2bc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2c1c95640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2bc0cedf0 0x7ff2bc0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2c1c95640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2bc1461f0 0x7ff2bc0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2c1c95640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc15d290 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2c1c95640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc15cfb0 con 0x7ff2bc0cedf0 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2c1c95640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc1465d0 con 0x7ff2bc1461f0 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 0x7ff2bc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 0x7ff2bc1530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43152/0 (socket says 172.21.15.114:43152) 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/3191016784 learned_addr learned my addr 172.21.15.114:0/3191016784 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2baffd640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2bc0cedf0 0x7ff2bc0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bbfff640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2bc1461f0 0x7ff2bc0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2bc1461f0 msgr2=0x7ff2bc0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2bc1461f0 0x7ff2bc0cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2bc0cedf0 msgr2=0x7ff2bc0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2bc0cedf0 0x7ff2bc0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2bb7fe640 1 -- 172.21.15.114:0/3191016784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0c7f70 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.917+0000 7ff2baffd640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2bc0cedf0 0x7ff2bc0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.918+0000 7ff2bb7fe640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 0x7ff2bc1530d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac034040 tx=0x7ff2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.918+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac035040 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.918+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac004230 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.918+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc0c8250 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.918+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac03a700 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.918+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc0c8810 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.919+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc0b53e0 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.919+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2ac038020 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.920+0000 7ff2a3fff640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2a806c8f0 0x7ff2a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.920+0000 7ff2baffd640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2a806c8f0 0x7ff2a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.920+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff2ac0ad940 con 0x7ff2bc0b3fe0 2024-04-13T02:45:30.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.920+0000 7ff2baffd640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2a806c8f0 0x7ff2a806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc142410 tx=0x7ff2b0007c50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:30.924+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2bc0b53e0 con 0x7ff2bc0b3fe0 2024-04-13T02:45:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.099+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2bc0b4d90 con 0x7ff2bc0b3fe0 2024-04-13T02:45:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.101+0000 7ff2a3fff640 1 -- 172.21.15.114:0/3191016784 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7ff2ac07bd70 con 0x7ff2bc0b3fe0 2024-04-13T02:45:31.102 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:31.102 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":31,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:45:29.451139+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2a806c8f0 msgr2=0x7ff2a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2a806c8f0 0x7ff2a806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc142410 tx=0x7ff2b0007c50 comp rx=0 tx=0).stop 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 msgr2=0x7ff2bc1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 0x7ff2bc1530d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac034040 tx=0x7ff2ac0046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 shutdown_connections 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff2a806c8f0 0x7ff2a806edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2bc1461f0 0x7ff2bc0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2bc0cedf0 0x7ff2bc0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 --2- 172.21.15.114:0/3191016784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2bc0b3fe0 0x7ff2bc1530d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 >> 172.21.15.114:0/3191016784 conn(0x7ff2bc0b27b0 msgr2=0x7ff2bc15f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:31.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 shutdown_connections 2024-04-13T02:45:31.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.103+0000 7ff2c1c95640 1 -- 172.21.15.114:0/3191016784 wait complete. 2024-04-13T02:45:31.114 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-13T02:45:31.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:45:31.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.213+0000 7f83a8c88640 1 Processor -- start 2024-04-13T02:45:31.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.213+0000 7f83a8c88640 1 -- start start 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.214+0000 7f83a8c88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a4070210 0x7f83a40b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.214+0000 7f83a8c88640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a406f940 con 0x7f83a40b5020 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.214+0000 7f83a8c88640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a406e8a0 con 0x7f83a415b6d0 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.214+0000 7f83a8c88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f83a40b5480 con 0x7f83a4070210 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f83a40b5020 0x7f83a415bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44906/0 (socket says 172.21.15.114:44906) 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a2d9d640 1 -- 172.21.15.114:0/892762842 learned_addr learned my addr 172.21.15.114:0/892762842 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a1d9b640 1 --2- 172.21.15.114:0/892762842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a4070210 0x7f83a40b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380874885 0 0) 0x7f83a406f940 con 0x7f83a40b5020 2024-04-13T02:45:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f838c003520 con 0x7f83a40b5020 2024-04-13T02:45:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3527592560 0 0) 0x7f83a406e8a0 con 0x7f83a415b6d0 2024-04-13T02:45:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a406f940 con 0x7f83a415b6d0 2024-04-13T02:45:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a1d9b640 1 -- 172.21.15.114:0/892762842 >> v1:172.21.15.130:6789/0 conn(0x7f83a415b6d0 legacy=0x7f83a40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a1d9b640 1 -- 172.21.15.114:0/892762842 >> v1:172.21.15.114:6789/0 conn(0x7f83a40b5020 legacy=0x7f83a415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 5753039 0 0) 0x7f838c003520 con 0x7f83a40b5020 2024-04-13T02:45:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.215+0000 7f83a1d9b640 1 -- 172.21.15.114:0/892762842 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a406eb80 con 0x7f83a4070210 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.216+0000 7f83a1d9b640 1 --2- 172.21.15.114:0/892762842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a4070210 0x7f83a40b4ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f83980097d0 tx=0x7f839802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5266c7de69fdfcf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.216+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398037070 con 0x7f83a4070210 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.216+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8398030510 con 0x7f83a4070210 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.216+0000 7f83a159a640 1 -- 172.21.15.114:0/892762842 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c001670 con 0x7f83a4070210 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 -- 172.21.15.114:0/892762842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a4070210 msgr2=0x7f83a40b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 --2- 172.21.15.114:0/892762842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a4070210 0x7f83a40b4ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f83980097d0 tx=0x7f839802b770 comp rx=0 tx=0).stop 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 -- 172.21.15.114:0/892762842 shutdown_connections 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 --2- 172.21.15.114:0/892762842 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a4070210 0x7f83a40b4ae0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 -- 172.21.15.114:0/892762842 >> 172.21.15.114:0/892762842 conn(0x7f83a40b27b0 msgr2=0x7f83a40b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 -- 172.21.15.114:0/892762842 shutdown_connections 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.217+0000 7f83a8c88640 1 -- 172.21.15.114:0/892762842 wait complete. 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.218+0000 7f83a8c88640 1 Processor -- start 2024-04-13T02:45:31.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.218+0000 7f83a8c88640 1 -- start start 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a8c88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a4070210 0x7f83a40ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a8c88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 0x7f83a40ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a8c88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a415b6d0 0x7f83a41e18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a8c88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83a406f420 con 0x7f83a40b5020 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a8c88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f83a406f180 con 0x7f83a4070210 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a8c88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f83a40ce420 con 0x7f83a415b6d0 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 0x7f83a40ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 0x7f83a40ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43162/0 (socket says 172.21.15.114:43162) 2024-04-13T02:45:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 -- 172.21.15.114:0/3865413648 learned_addr learned my addr 172.21.15.114:0/3865413648 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a259c640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a4070210 0x7f83a40ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a2d9d640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a415b6d0 0x7f83a41e18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 -- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a415b6d0 msgr2=0x7f83a41e18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a415b6d0 0x7f83a41e18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 -- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a4070210 msgr2=0x7f83a40ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a4070210 0x7f83a40ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 -- 172.21.15.114:0/3865413648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a40ad940 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f83a1d9b640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 0x7f83a40ae980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8398035040 tx=0x7f83980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.219+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398040020 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.220+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8398038040 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.220+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a40adbc0 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.220+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398037070 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.220+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a40ae460 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.221+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a40adfb0 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.221+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8398043020 con 0x7f83a40b5020 2024-04-13T02:45:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.221+0000 7f8392ffd640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f838406c8f0 0x7f838406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.221+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f83980acda0 con 0x7f83a40b5020 2024-04-13T02:45:31.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.221+0000 7f83a259c640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f838406c8f0 0x7f838406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.222+0000 7f83a259c640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f838406c8f0 0x7f838406edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8394001560 tx=0x7f8394009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.226+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f839804a030 con 0x7f83a40b5020 2024-04-13T02:45:31.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.398+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83a4068c80 con 0x7f838406c8f0 2024-04-13T02:45:31.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.404+0000 7f8392ffd640 1 -- 172.21.15.114:0/3865413648 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f83a4068c80 con 0x7f838406c8f0 2024-04-13T02:45:31.408 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:45:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f838406c8f0 msgr2=0x7f838406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f838406c8f0 0x7f838406edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8394001560 tx=0x7f8394009040 comp rx=0 tx=0).stop 2024-04-13T02:45:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 msgr2=0x7f83a40ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 0x7f83a40ae980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8398035040 tx=0x7f83980046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 shutdown_connections 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f838406c8f0 0x7f838406edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a415b6d0 0x7f83a41e18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b5020 0x7f83a40ae980 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 --2- 172.21.15.114:0/3865413648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a4070210 0x7f83a40ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 >> 172.21.15.114:0/3865413648 conn(0x7f83a40b27b0 msgr2=0x7f83a4152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 shutdown_connections 2024-04-13T02:45:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.408+0000 7f83a8c88640 1 -- 172.21.15.114:0/3865413648 wait complete. 2024-04-13T02:45:31.419 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-13T02:45:29.496994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000560"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447920+0000","last_change":"2024-04-13T02:45:27.447920+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447920+0000","last_undegraded":"2024-04-13T02:45:27.447920+0000","last_fullsized":"2024-04-13T02:45:27.447920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447887+0000","last_change":"2024-04-13T02:45:27.447887+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447887+0000","last_undegraded":"2024-04-13T02:45:27.447887+0000","last_fullsized":"2024-04-13T02:45:27.447887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455265+0000","last_change":"2024-04-13T02:45:27.455265+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455265+0000","last_undegraded":"2024-04-13T02:45:27.455265+0000","last_fullsized":"2024-04-13T02:45:27.455265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448666+0000","last_change":"2024-04-13T02:45:27.448666+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448666+0000","last_undegraded":"2024-04-13T02:45:27.448666+0000","last_fullsized":"2024-04-13T02:45:27.448666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449012+0000","last_change":"2024-04-13T02:45:27.449012+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449012+0000","last_undegraded":"2024-04-13T02:45:27.449012+0000","last_fullsized":"2024-04-13T02:45:27.449012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447447+0000","last_change":"2024-04-13T02:45:27.447447+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447447+0000","last_undegraded":"2024-04-13T02:45:27.447447+0000","last_fullsized":"2024-04-13T02:45:27.447447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454677+0000","last_change":"2024-04-13T02:45:27.454677+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454677+0000","last_undegraded":"2024-04-13T02:45:27.454677+0000","last_fullsized":"2024-04-13T02:45:27.454677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454146+0000","last_change":"2024-04-13T02:45:27.454146+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454146+0000","last_undegraded":"2024-04-13T02:45:27.454146+0000","last_fullsized":"2024-04-13T02:45:27.454146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449888+0000","last_change":"2024-04-13T02:45:27.449888+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449888+0000","last_undegraded":"2024-04-13T02:45:27.449888+0000","last_fullsized":"2024-04-13T02:45:27.449888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448126+0000","last_change":"2024-04-13T02:45:27.448126+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448126+0000","last_undegraded":"2024-04-13T02:45:27.448126+0000","last_fullsized":"2024-04-13T02:45:27.448126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453139+0000","last_change":"2024-04-13T02:45:27.453139+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453139+0000","last_undegraded":"2024-04-13T02:45:27.453139+0000","last_fullsized":"2024-04-13T02:45:27.453139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454708+0000","last_change":"2024-04-13T02:45:27.454708+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454708+0000","last_undegraded":"2024-04-13T02:45:27.454708+0000","last_fullsized":"2024-04-13T02:45:27.454708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448573+0000","last_change":"2024-04-13T02:45:27.448573+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448573+0000","last_undegraded":"2024-04-13T02:45:27.448573+0000","last_fullsized":"2024-04-13T02:45:27.448573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446972+0000","last_change":"2024-04-13T02:45:27.446972+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446972+0000","last_undegraded":"2024-04-13T02:45:27.446972+0000","last_fullsized":"2024-04-13T02:45:27.446972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454032+0000","last_change":"2024-04-13T02:45:27.454032+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454032+0000","last_undegraded":"2024-04-13T02:45:27.454032+0000","last_fullsized":"2024-04-13T02:45:27.454032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453363+0000","last_change":"2024-04-13T02:45:27.453363+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453363+0000","last_undegraded":"2024-04-13T02:45:27.453363+0000","last_fullsized":"2024-04-13T02:45:27.453363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453654+0000","last_change":"2024-04-13T02:45:27.453654+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453654+0000","last_undegraded":"2024-04-13T02:45:27.453654+0000","last_fullsized":"2024-04-13T02:45:27.453654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447475+0000","last_change":"2024-04-13T02:45:27.447475+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447475+0000","last_undegraded":"2024-04-13T02:45:27.447475+0000","last_fullsized":"2024-04-13T02:45:27.447475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449070+0000","last_change":"2024-04-13T02:45:27.449070+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449070+0000","last_undegraded":"2024-04-13T02:45:27.449070+0000","last_fullsized":"2024-04-13T02:45:27.449070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450358+0000","last_change":"2024-04-13T02:45:27.450358+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450358+0000","last_undegraded":"2024-04-13T02:45:27.450358+0000","last_fullsized":"2024-04-13T02:45:27.450358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451958+0000","last_change":"2024-04-13T02:45:27.451958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451958+0000","last_undegraded":"2024-04-13T02:45:27.451958+0000","last_fullsized":"2024-04-13T02:45:27.451958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451088+0000","last_change":"2024-04-13T02:45:27.451088+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451088+0000","last_undegraded":"2024-04-13T02:45:27.451088+0000","last_fullsized":"2024-04-13T02:45:27.451088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447589+0000","last_change":"2024-04-13T02:45:27.447589+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447589+0000","last_undegraded":"2024-04-13T02:45:27.447589+0000","last_fullsized":"2024-04-13T02:45:27.447589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453531+0000","last_change":"2024-04-13T02:45:27.453531+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453531+0000","last_undegraded":"2024-04-13T02:45:27.453531+0000","last_fullsized":"2024-04-13T02:45:27.453531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447133+0000","last_change":"2024-04-13T02:45:27.447133+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447133+0000","last_undegraded":"2024-04-13T02:45:27.447133+0000","last_fullsized":"2024-04-13T02:45:27.447133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447034+0000","last_change":"2024-04-13T02:45:27.447034+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447034+0000","last_undegraded":"2024-04-13T02:45:27.447034+0000","last_fullsized":"2024-04-13T02:45:27.447034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448895+0000","last_change":"2024-04-13T02:45:27.448895+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448895+0000","last_undegraded":"2024-04-13T02:45:27.448895+0000","last_fullsized":"2024-04-13T02:45:27.448895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453593+0000","last_change":"2024-04-13T02:45:27.453593+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453593+0000","last_undegraded":"2024-04-13T02:45:27.453593+0000","last_fullsized":"2024-04-13T02:45:27.453593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451549+0000","last_change":"2024-04-13T02:45:27.451549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451549+0000","last_undegraded":"2024-04-13T02:45:27.451549+0000","last_fullsized":"2024-04-13T02:45:27.451549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452422+0000","last_change":"2024-04-13T02:45:27.452422+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452422+0000","last_undegraded":"2024-04-13T02:45:27.452422+0000","last_fullsized":"2024-04-13T02:45:27.452422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447806+0000","last_change":"2024-04-13T02:45:27.447806+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447806+0000","last_undegraded":"2024-04-13T02:45:27.447806+0000","last_fullsized":"2024-04-13T02:45:27.447806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451834+0000","last_change":"2024-04-13T02:45:27.451834+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451834+0000","last_undegraded":"2024-04-13T02:45:27.451834+0000","last_fullsized":"2024-04-13T02:45:27.451834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447569+0000","last_change":"2024-04-13T02:45:27.447569+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447569+0000","last_undegraded":"2024-04-13T02:45:27.447569+0000","last_fullsized":"2024-04-13T02:45:27.447569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462331+0000","last_change":"2024-04-13T02:45:27.459686+0000","last_active":"2024-04-13T02:45:27.462331+0000","last_peered":"2024-04-13T02:45:27.462331+0000","last_clean":"2024-04-13T02:45:27.462331+0000","last_became_active":"2024-04-13T02:45:27.459384+0000","last_became_peered":"2024-04-13T02:45:27.459384+0000","last_unstale":"2024-04-13T02:45:27.462331+0000","last_undegraded":"2024-04-13T02:45:27.462331+0000","last_fullsized":"2024-04-13T02:45:27.462331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447464+0000","last_change":"2024-04-13T02:45:27.447464+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447464+0000","last_undegraded":"2024-04-13T02:45:27.447464+0000","last_fullsized":"2024-04-13T02:45:27.447464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.457081+0000","last_change":"2024-04-13T02:45:27.456362+0000","last_active":"2024-04-13T02:45:27.457081+0000","last_peered":"2024-04-13T02:45:27.457081+0000","last_clean":"2024-04-13T02:45:27.457081+0000","last_became_active":"2024-04-13T02:45:27.456078+0000","last_became_peered":"2024-04-13T02:45:27.456078+0000","last_unstale":"2024-04-13T02:45:27.457081+0000","last_undegraded":"2024-04-13T02:45:27.457081+0000","last_fullsized":"2024-04-13T02:45:27.457081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451381+0000","last_change":"2024-04-13T02:45:27.451381+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451381+0000","last_undegraded":"2024-04-13T02:45:27.451381+0000","last_fullsized":"2024-04-13T02:45:27.451381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464937+0000","last_change":"2024-04-13T02:45:27.460638+0000","last_active":"2024-04-13T02:45:27.464937+0000","last_peered":"2024-04-13T02:45:27.464937+0000","last_clean":"2024-04-13T02:45:27.464937+0000","last_became_active":"2024-04-13T02:45:27.460344+0000","last_became_peered":"2024-04-13T02:45:27.460344+0000","last_unstale":"2024-04-13T02:45:27.464937+0000","last_undegraded":"2024-04-13T02:45:27.464937+0000","last_fullsized":"2024-04-13T02:45:27.464937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446549+0000","last_change":"2024-04-13T02:45:27.446549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446549+0000","last_undegraded":"2024-04-13T02:45:27.446549+0000","last_fullsized":"2024-04-13T02:45:27.446549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462289+0000","last_change":"2024-04-13T02:45:27.460024+0000","last_active":"2024-04-13T02:45:27.462289+0000","last_peered":"2024-04-13T02:45:27.462289+0000","last_clean":"2024-04-13T02:45:27.462289+0000","last_became_active":"2024-04-13T02:45:27.459710+0000","last_became_peered":"2024-04-13T02:45:27.459710+0000","last_unstale":"2024-04-13T02:45:27.462289+0000","last_undegraded":"2024-04-13T02:45:27.462289+0000","last_fullsized":"2024-04-13T02:45:27.462289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:23:16.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450455+0000","last_change":"2024-04-13T02:45:27.450455+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450455+0000","last_undegraded":"2024-04-13T02:45:27.450455+0000","last_fullsized":"2024-04-13T02:45:27.450455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460486+0000","last_change":"2024-04-13T02:45:27.458957+0000","last_active":"2024-04-13T02:45:27.460486+0000","last_peered":"2024-04-13T02:45:27.460486+0000","last_clean":"2024-04-13T02:45:27.460486+0000","last_became_active":"2024-04-13T02:45:27.458428+0000","last_became_peered":"2024-04-13T02:45:27.458428+0000","last_unstale":"2024-04-13T02:45:27.460486+0000","last_undegraded":"2024-04-13T02:45:27.460486+0000","last_fullsized":"2024-04-13T02:45:27.460486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:29:38.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453505+0000","last_change":"2024-04-13T02:45:27.453505+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453505+0000","last_undegraded":"2024-04-13T02:45:27.453505+0000","last_fullsized":"2024-04-13T02:45:27.453505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460516+0000","last_change":"2024-04-13T02:45:27.459153+0000","last_active":"2024-04-13T02:45:27.460516+0000","last_peered":"2024-04-13T02:45:27.460516+0000","last_clean":"2024-04-13T02:45:27.460516+0000","last_became_active":"2024-04-13T02:45:27.458853+0000","last_became_peered":"2024-04-13T02:45:27.458853+0000","last_unstale":"2024-04-13T02:45:27.460516+0000","last_undegraded":"2024-04-13T02:45:27.460516+0000","last_fullsized":"2024-04-13T02:45:27.460516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:51:22.207135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450302+0000","last_change":"2024-04-13T02:45:27.450302+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450302+0000","last_undegraded":"2024-04-13T02:45:27.450302+0000","last_fullsized":"2024-04-13T02:45:27.450302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464787+0000","last_change":"2024-04-13T02:45:27.457617+0000","last_active":"2024-04-13T02:45:27.464787+0000","last_peered":"2024-04-13T02:45:27.464787+0000","last_clean":"2024-04-13T02:45:27.464787+0000","last_became_active":"2024-04-13T02:45:27.457319+0000","last_became_peered":"2024-04-13T02:45:27.457319+0000","last_unstale":"2024-04-13T02:45:27.464787+0000","last_undegraded":"2024-04-13T02:45:27.464787+0000","last_fullsized":"2024-04-13T02:45:27.464787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446037+0000","last_change":"2024-04-13T02:45:27.446037+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446037+0000","last_undegraded":"2024-04-13T02:45:27.446037+0000","last_fullsized":"2024-04-13T02:45:27.446037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465195+0000","last_change":"2024-04-13T02:45:27.463132+0000","last_active":"2024-04-13T02:45:27.465195+0000","last_peered":"2024-04-13T02:45:27.465195+0000","last_clean":"2024-04-13T02:45:27.465195+0000","last_became_active":"2024-04-13T02:45:27.462833+0000","last_became_peered":"2024-04-13T02:45:27.462833+0000","last_unstale":"2024-04-13T02:45:27.465195+0000","last_undegraded":"2024-04-13T02:45:27.465195+0000","last_fullsized":"2024-04-13T02:45:27.465195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:10:33.583403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452371+0000","last_change":"2024-04-13T02:45:27.452371+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452371+0000","last_undegraded":"2024-04-13T02:45:27.452371+0000","last_fullsized":"2024-04-13T02:45:27.452371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462081+0000","last_change":"2024-04-13T02:45:27.456759+0000","last_active":"2024-04-13T02:45:27.462081+0000","last_peered":"2024-04-13T02:45:27.462081+0000","last_clean":"2024-04-13T02:45:27.462081+0000","last_became_active":"2024-04-13T02:45:27.456503+0000","last_became_peered":"2024-04-13T02:45:27.456503+0000","last_unstale":"2024-04-13T02:45:27.462081+0000","last_undegraded":"2024-04-13T02:45:27.462081+0000","last_fullsized":"2024-04-13T02:45:27.462081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:01:31.847609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450027+0000","last_change":"2024-04-13T02:45:27.450027+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450027+0000","last_undegraded":"2024-04-13T02:45:27.450027+0000","last_fullsized":"2024-04-13T02:45:27.450027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462361+0000","last_change":"2024-04-13T02:45:27.458838+0000","last_active":"2024-04-13T02:45:27.462361+0000","last_peered":"2024-04-13T02:45:27.462361+0000","last_clean":"2024-04-13T02:45:27.462361+0000","last_became_active":"2024-04-13T02:45:27.458520+0000","last_became_peered":"2024-04-13T02:45:27.458520+0000","last_unstale":"2024-04-13T02:45:27.462361+0000","last_undegraded":"2024-04-13T02:45:27.462361+0000","last_fullsized":"2024-04-13T02:45:27.462361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449541+0000","last_change":"2024-04-13T02:45:27.449541+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449541+0000","last_undegraded":"2024-04-13T02:45:27.449541+0000","last_fullsized":"2024-04-13T02:45:27.449541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464181+0000","last_change":"2024-04-13T02:45:27.463079+0000","last_active":"2024-04-13T02:45:27.464181+0000","last_peered":"2024-04-13T02:45:27.464181+0000","last_clean":"2024-04-13T02:45:27.464181+0000","last_became_active":"2024-04-13T02:45:27.461886+0000","last_became_peered":"2024-04-13T02:45:27.461886+0000","last_unstale":"2024-04-13T02:45:27.464181+0000","last_undegraded":"2024-04-13T02:45:27.464181+0000","last_fullsized":"2024-04-13T02:45:27.464181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455683+0000","last_change":"2024-04-13T02:45:27.455683+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455683+0000","last_undegraded":"2024-04-13T02:45:27.455683+0000","last_fullsized":"2024-04-13T02:45:27.455683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464924+0000","last_change":"2024-04-13T02:45:27.460661+0000","last_active":"2024-04-13T02:45:27.464924+0000","last_peered":"2024-04-13T02:45:27.464924+0000","last_clean":"2024-04-13T02:45:27.464924+0000","last_became_active":"2024-04-13T02:45:27.460173+0000","last_became_peered":"2024-04-13T02:45:27.460173+0000","last_unstale":"2024-04-13T02:45:27.464924+0000","last_undegraded":"2024-04-13T02:45:27.464924+0000","last_fullsized":"2024-04-13T02:45:27.464924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:52.554776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446026+0000","last_change":"2024-04-13T02:45:27.446026+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446026+0000","last_undegraded":"2024-04-13T02:45:27.446026+0000","last_fullsized":"2024-04-13T02:45:27.446026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465212+0000","last_change":"2024-04-13T02:45:27.463704+0000","last_active":"2024-04-13T02:45:27.465212+0000","last_peered":"2024-04-13T02:45:27.465212+0000","last_clean":"2024-04-13T02:45:27.465212+0000","last_became_active":"2024-04-13T02:45:27.463451+0000","last_became_peered":"2024-04-13T02:45:27.463451+0000","last_unstale":"2024-04-13T02:45:27.465212+0000","last_undegraded":"2024-04-13T02:45:27.465212+0000","last_fullsized":"2024-04-13T02:45:27.465212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:31:03.954328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449471+0000","last_change":"2024-04-13T02:45:27.449471+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449471+0000","last_undegraded":"2024-04-13T02:45:27.449471+0000","last_fullsized":"2024-04-13T02:45:27.449471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.459655+0000","last_change":"2024-04-13T02:45:27.455259+0000","last_active":"2024-04-13T02:45:27.459655+0000","last_peered":"2024-04-13T02:45:27.459655+0000","last_clean":"2024-04-13T02:45:27.459655+0000","last_became_active":"2024-04-13T02:45:27.454963+0000","last_became_peered":"2024-04-13T02:45:27.454963+0000","last_unstale":"2024-04-13T02:45:27.459655+0000","last_undegraded":"2024-04-13T02:45:27.459655+0000","last_fullsized":"2024-04-13T02:45:27.459655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449030+0000","last_change":"2024-04-13T02:45:27.449030+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449030+0000","last_undegraded":"2024-04-13T02:45:27.449030+0000","last_fullsized":"2024-04-13T02:45:27.449030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462043+0000","last_change":"2024-04-13T02:45:27.456096+0000","last_active":"2024-04-13T02:45:27.462043+0000","last_peered":"2024-04-13T02:45:27.462043+0000","last_clean":"2024-04-13T02:45:27.462043+0000","last_became_active":"2024-04-13T02:45:27.455814+0000","last_became_peered":"2024-04-13T02:45:27.455814+0000","last_unstale":"2024-04-13T02:45:27.462043+0000","last_undegraded":"2024-04-13T02:45:27.462043+0000","last_fullsized":"2024-04-13T02:45:27.462043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:04:37.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447254+0000","last_change":"2024-04-13T02:45:27.447254+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447254+0000","last_undegraded":"2024-04-13T02:45:27.447254+0000","last_fullsized":"2024-04-13T02:45:27.447254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464950+0000","last_change":"2024-04-13T02:45:27.461165+0000","last_active":"2024-04-13T02:45:27.464950+0000","last_peered":"2024-04-13T02:45:27.464950+0000","last_clean":"2024-04-13T02:45:27.464950+0000","last_became_active":"2024-04-13T02:45:27.460919+0000","last_became_peered":"2024-04-13T02:45:27.460919+0000","last_unstale":"2024-04-13T02:45:27.464950+0000","last_undegraded":"2024-04-13T02:45:27.464950+0000","last_fullsized":"2024-04-13T02:45:27.464950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:42.420394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449963+0000","last_change":"2024-04-13T02:45:27.449963+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449963+0000","last_undegraded":"2024-04-13T02:45:27.449963+0000","last_fullsized":"2024-04-13T02:45:27.449963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462227+0000","last_change":"2024-04-13T02:45:27.456385+0000","last_active":"2024-04-13T02:45:27.462227+0000","last_peered":"2024-04-13T02:45:27.462227+0000","last_clean":"2024-04-13T02:45:27.462227+0000","last_became_active":"2024-04-13T02:45:27.456119+0000","last_became_peered":"2024-04-13T02:45:27.456119+0000","last_unstale":"2024-04-13T02:45:27.462227+0000","last_undegraded":"2024-04-13T02:45:27.462227+0000","last_fullsized":"2024-04-13T02:45:27.462227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456905+0000","last_change":"2024-04-13T02:45:27.456905+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456905+0000","last_undegraded":"2024-04-13T02:45:27.456905+0000","last_fullsized":"2024-04-13T02:45:27.456905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464275+0000","last_change":"2024-04-13T02:45:27.462257+0000","last_active":"2024-04-13T02:45:27.464275+0000","last_peered":"2024-04-13T02:45:27.464275+0000","last_clean":"2024-04-13T02:45:27.464275+0000","last_became_active":"2024-04-13T02:45:27.461973+0000","last_became_peered":"2024-04-13T02:45:27.461973+0000","last_unstale":"2024-04-13T02:45:27.464275+0000","last_undegraded":"2024-04-13T02:45:27.464275+0000","last_fullsized":"2024-04-13T02:45:27.464275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:53:32.487804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446021+0000","last_change":"2024-04-13T02:45:27.446021+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446021+0000","last_undegraded":"2024-04-13T02:45:27.446021+0000","last_fullsized":"2024-04-13T02:45:27.446021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465172+0000","last_change":"2024-04-13T02:45:27.463019+0000","last_active":"2024-04-13T02:45:27.465172+0000","last_peered":"2024-04-13T02:45:27.465172+0000","last_clean":"2024-04-13T02:45:27.465172+0000","last_became_active":"2024-04-13T02:45:27.462366+0000","last_became_peered":"2024-04-13T02:45:27.462366+0000","last_unstale":"2024-04-13T02:45:27.465172+0000","last_undegraded":"2024-04-13T02:45:27.465172+0000","last_fullsized":"2024-04-13T02:45:27.465172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:39:25.055157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451008+0000","last_change":"2024-04-13T02:45:27.451008+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451008+0000","last_undegraded":"2024-04-13T02:45:27.451008+0000","last_fullsized":"2024-04-13T02:45:27.451008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465174+0000","last_change":"2024-04-13T02:45:27.463016+0000","last_active":"2024-04-13T02:45:27.465174+0000","last_peered":"2024-04-13T02:45:27.465174+0000","last_clean":"2024-04-13T02:45:27.465174+0000","last_became_active":"2024-04-13T02:45:27.462717+0000","last_became_peered":"2024-04-13T02:45:27.462717+0000","last_unstale":"2024-04-13T02:45:27.465174+0000","last_undegraded":"2024-04-13T02:45:27.465174+0000","last_fullsized":"2024-04-13T02:45:27.465174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:18:15.566653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447467+0000","last_change":"2024-04-13T02:45:27.447467+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447467+0000","last_undegraded":"2024-04-13T02:45:27.447467+0000","last_fullsized":"2024-04-13T02:45:27.447467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.458459+0000","last_change":"2024-04-13T02:45:27.457724+0000","last_active":"2024-04-13T02:45:27.458459+0000","last_peered":"2024-04-13T02:45:27.458459+0000","last_clean":"2024-04-13T02:45:27.458459+0000","last_became_active":"2024-04-13T02:45:27.457432+0000","last_became_peered":"2024-04-13T02:45:27.457432+0000","last_unstale":"2024-04-13T02:45:27.458459+0000","last_undegraded":"2024-04-13T02:45:27.458459+0000","last_fullsized":"2024-04-13T02:45:27.458459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448118+0000","last_change":"2024-04-13T02:45:27.448118+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448118+0000","last_undegraded":"2024-04-13T02:45:27.448118+0000","last_fullsized":"2024-04-13T02:45:27.448118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462616+0000","last_change":"2024-04-13T02:45:27.460601+0000","last_active":"2024-04-13T02:45:27.462616+0000","last_peered":"2024-04-13T02:45:27.462616+0000","last_clean":"2024-04-13T02:45:27.462616+0000","last_became_active":"2024-04-13T02:45:27.460291+0000","last_became_peered":"2024-04-13T02:45:27.460291+0000","last_unstale":"2024-04-13T02:45:27.462616+0000","last_undegraded":"2024-04-13T02:45:27.462616+0000","last_fullsized":"2024-04-13T02:45:27.462616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450965+0000","last_change":"2024-04-13T02:45:27.450965+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450965+0000","last_undegraded":"2024-04-13T02:45:27.450965+0000","last_fullsized":"2024-04-13T02:45:27.450965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460959+0000","last_change":"2024-04-13T02:45:27.460370+0000","last_active":"2024-04-13T02:45:27.460959+0000","last_peered":"2024-04-13T02:45:27.460959+0000","last_clean":"2024-04-13T02:45:27.460959+0000","last_became_active":"2024-04-13T02:45:27.460094+0000","last_became_peered":"2024-04-13T02:45:27.460094+0000","last_unstale":"2024-04-13T02:45:27.460959+0000","last_undegraded":"2024-04-13T02:45:27.460959+0000","last_fullsized":"2024-04-13T02:45:27.460959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:53.178316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449120+0000","last_change":"2024-04-13T02:45:27.449120+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449120+0000","last_undegraded":"2024-04-13T02:45:27.449120+0000","last_fullsized":"2024-04-13T02:45:27.449120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.463557+0000","last_change":"2024-04-13T02:45:27.461869+0000","last_active":"2024-04-13T02:45:27.463557+0000","last_peered":"2024-04-13T02:45:27.463557+0000","last_clean":"2024-04-13T02:45:27.463557+0000","last_became_active":"2024-04-13T02:45:27.461565+0000","last_became_peered":"2024-04-13T02:45:27.461565+0000","last_unstale":"2024-04-13T02:45:27.463557+0000","last_undegraded":"2024-04-13T02:45:27.463557+0000","last_fullsized":"2024-04-13T02:45:27.463557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450936+0000","last_change":"2024-04-13T02:45:27.450936+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450936+0000","last_undegraded":"2024-04-13T02:45:27.450936+0000","last_fullsized":"2024-04-13T02:45:27.450936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462542+0000","last_change":"2024-04-13T02:45:27.459353+0000","last_active":"2024-04-13T02:45:27.462542+0000","last_peered":"2024-04-13T02:45:27.462542+0000","last_clean":"2024-04-13T02:45:27.462542+0000","last_became_active":"2024-04-13T02:45:27.459099+0000","last_became_peered":"2024-04-13T02:45:27.459099+0000","last_unstale":"2024-04-13T02:45:27.462542+0000","last_undegraded":"2024-04-13T02:45:27.462542+0000","last_fullsized":"2024-04-13T02:45:27.462542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456493+0000","last_change":"2024-04-13T02:45:27.456493+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456493+0000","last_undegraded":"2024-04-13T02:45:27.456493+0000","last_fullsized":"2024-04-13T02:45:27.456493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.454193+0000","last_change":"2024-04-13T02:45:27.453586+0000","last_active":"2024-04-13T02:45:27.454193+0000","last_peered":"2024-04-13T02:45:27.454193+0000","last_clean":"2024-04-13T02:45:27.454193+0000","last_became_active":"2024-04-13T02:45:27.453276+0000","last_became_peered":"2024-04-13T02:45:27.453276+0000","last_unstale":"2024-04-13T02:45:27.454193+0000","last_undegraded":"2024-04-13T02:45:27.454193+0000","last_fullsized":"2024-04-13T02:45:27.454193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446976+0000","last_change":"2024-04-13T02:45:27.446976+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446976+0000","last_undegraded":"2024-04-13T02:45:27.446976+0000","last_fullsized":"2024-04-13T02:45:27.446976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462322+0000","last_change":"2024-04-13T02:45:27.456466+0000","last_active":"2024-04-13T02:45:27.462322+0000","last_peered":"2024-04-13T02:45:27.462322+0000","last_clean":"2024-04-13T02:45:27.462322+0000","last_became_active":"2024-04-13T02:45:27.456102+0000","last_became_peered":"2024-04-13T02:45:27.456102+0000","last_unstale":"2024-04-13T02:45:27.462322+0000","last_undegraded":"2024-04-13T02:45:27.462322+0000","last_fullsized":"2024-04-13T02:45:27.462322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447740+0000","last_change":"2024-04-13T02:45:27.447740+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447740+0000","last_undegraded":"2024-04-13T02:45:27.447740+0000","last_fullsized":"2024-04-13T02:45:27.447740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462244+0000","last_change":"2024-04-13T02:45:27.458418+0000","last_active":"2024-04-13T02:45:27.462244+0000","last_peered":"2024-04-13T02:45:27.462244+0000","last_clean":"2024-04-13T02:45:27.462244+0000","last_became_active":"2024-04-13T02:45:27.458118+0000","last_became_peered":"2024-04-13T02:45:27.458118+0000","last_unstale":"2024-04-13T02:45:27.462244+0000","last_undegraded":"2024-04-13T02:45:27.462244+0000","last_fullsized":"2024-04-13T02:45:27.462244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447941+0000","last_change":"2024-04-13T02:45:27.447941+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447941+0000","last_undegraded":"2024-04-13T02:45:27.447941+0000","last_fullsized":"2024-04-13T02:45:27.447941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462292+0000","last_change":"2024-04-13T02:45:27.458631+0000","last_active":"2024-04-13T02:45:27.462292+0000","last_peered":"2024-04-13T02:45:27.462292+0000","last_clean":"2024-04-13T02:45:27.462292+0000","last_became_active":"2024-04-13T02:45:27.458346+0000","last_became_peered":"2024-04-13T02:45:27.458346+0000","last_unstale":"2024-04-13T02:45:27.462292+0000","last_undegraded":"2024-04-13T02:45:27.462292+0000","last_fullsized":"2024-04-13T02:45:27.462292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449799+0000","last_change":"2024-04-13T02:45:27.449799+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449799+0000","last_undegraded":"2024-04-13T02:45:27.449799+0000","last_fullsized":"2024-04-13T02:45:27.449799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460530+0000","last_change":"2024-04-13T02:45:27.459295+0000","last_active":"2024-04-13T02:45:27.460530+0000","last_peered":"2024-04-13T02:45:27.460530+0000","last_clean":"2024-04-13T02:45:27.460530+0000","last_became_active":"2024-04-13T02:45:27.459013+0000","last_became_peered":"2024-04-13T02:45:27.459013+0000","last_unstale":"2024-04-13T02:45:27.460530+0000","last_undegraded":"2024-04-13T02:45:27.460530+0000","last_fullsized":"2024-04-13T02:45:27.460530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:57:33.753742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449958+0000","last_change":"2024-04-13T02:45:27.449958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449958+0000","last_undegraded":"2024-04-13T02:45:27.449958+0000","last_fullsized":"2024-04-13T02:45:27.449958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462088+0000","last_change":"2024-04-13T02:45:27.455763+0000","last_active":"2024-04-13T02:45:27.462088+0000","last_peered":"2024-04-13T02:45:27.462088+0000","last_clean":"2024-04-13T02:45:27.462088+0000","last_became_active":"2024-04-13T02:45:27.455501+0000","last_became_peered":"2024-04-13T02:45:27.455501+0000","last_unstale":"2024-04-13T02:45:27.462088+0000","last_undegraded":"2024-04-13T02:45:27.462088+0000","last_fullsized":"2024-04-13T02:45:27.462088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:14:18.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449262+0000","last_change":"2024-04-13T02:45:27.449262+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449262+0000","last_undegraded":"2024-04-13T02:45:27.449262+0000","last_fullsized":"2024-04-13T02:45:27.449262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462291+0000","last_change":"2024-04-13T02:45:27.457081+0000","last_active":"2024-04-13T02:45:27.462291+0000","last_peered":"2024-04-13T02:45:27.462291+0000","last_clean":"2024-04-13T02:45:27.462291+0000","last_became_active":"2024-04-13T02:45:27.456809+0000","last_became_peered":"2024-04-13T02:45:27.456809+0000","last_unstale":"2024-04-13T02:45:27.462291+0000","last_undegraded":"2024-04-13T02:45:27.462291+0000","last_fullsized":"2024-04-13T02:45:27.462291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.449801+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:45:27.449801+0000","last_peered":"2024-04-13T02:45:27.449801+0000","last_clean":"2024-04-13T02:45:27.449801+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:45:27.449801+0000","last_undegraded":"2024-04-13T02:45:27.449801+0000","last_fullsized":"2024-04-13T02:45:27.449801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:45:31.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:45:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.560+0000 7f8e5775e640 1 Processor -- start 2024-04-13T02:45:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.560+0000 7f8e5775e640 1 -- start start 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e5775e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e5015edb0 0x7f8e5009ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e5775e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e500ce860 0x7f8e5009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e5775e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5006cd90 con 0x7f8e500b3ec0 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e5775e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8e500cce20 con 0x7f8e5015edb0 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e5775e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5006d070 con 0x7f8e500ce860 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e554fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e5015edb0 0x7f8e5009ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e54cf9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8e500b3ec0 0x7f8e500c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44908/0 (socket says 172.21.15.114:44908) 2024-04-13T02:45:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e54cf9640 1 -- 172.21.15.114:0/4176334449 learned_addr learned my addr 172.21.15.114:0/4176334449 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e554fa640 1 -- 172.21.15.114:0/4176334449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e500ce860 msgr2=0x7f8e5009b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e554fa640 1 --2- 172.21.15.114:0/4176334449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e500ce860 0x7f8e5009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e554fa640 1 -- 172.21.15.114:0/4176334449 >> v1:172.21.15.114:6789/0 conn(0x7f8e500b3ec0 legacy=0x7f8e500c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e554fa640 1 -- 172.21.15.114:0/4176334449 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e500cd070 con 0x7f8e5015edb0 2024-04-13T02:45:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.561+0000 7f8e47fff640 1 -- 172.21.15.114:0/4176334449 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993614166 0 0) 0x7f8e5006cd90 con 0x7f8e500b3ec0 2024-04-13T02:45:31.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.562+0000 7f8e554fa640 1 --2- 172.21.15.114:0/4176334449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e5015edb0 0x7f8e5009ab90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0097a0 tx=0x7f8e4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28cd4984d8293fc server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.562+0000 7f8e47fff640 1 -- 172.21.15.114:0/4176334449 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c035020 con 0x7f8e5015edb0 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.562+0000 7f8e47fff640 1 -- 172.21.15.114:0/4176334449 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c031830 con 0x7f8e5015edb0 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.562+0000 7f8e47fff640 1 -- 172.21.15.114:0/4176334449 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c031c00 con 0x7f8e5015edb0 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 -- 172.21.15.114:0/4176334449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e5015edb0 msgr2=0x7f8e5009ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 --2- 172.21.15.114:0/4176334449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e5015edb0 0x7f8e5009ab90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0097a0 tx=0x7f8e4c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 -- 172.21.15.114:0/4176334449 shutdown_connections 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 --2- 172.21.15.114:0/4176334449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e500ce860 0x7f8e5009b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 --2- 172.21.15.114:0/4176334449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e5015edb0 0x7f8e5009ab90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 -- 172.21.15.114:0/4176334449 >> 172.21.15.114:0/4176334449 conn(0x7f8e500d27d0 msgr2=0x7f8e500d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 -- 172.21.15.114:0/4176334449 shutdown_connections 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.563+0000 7f8e5775e640 1 -- 172.21.15.114:0/4176334449 wait complete. 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.564+0000 7f8e5775e640 1 Processor -- start 2024-04-13T02:45:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.564+0000 7f8e5775e640 1 -- start start 2024-04-13T02:45:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.564+0000 7f8e5775e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e500b3ec0 0x7f8e500b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 0x7f8e501505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e5015edb0 0x7f8e5015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5006d450 con 0x7f8e500ce860 2024-04-13T02:45:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5006ca40 con 0x7f8e500b3ec0 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5006d5d0 con 0x7f8e5015edb0 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 0x7f8e501505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 0x7f8e501505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43178/0 (socket says 172.21.15.114:43178) 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 -- 172.21.15.114:0/3805201404 learned_addr learned my addr 172.21.15.114:0/3805201404 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e554fa640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e500b3ec0 0x7f8e500b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e55cfb640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e5015edb0 0x7f8e5015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 -- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e5015edb0 msgr2=0x7f8e5015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e5015edb0 0x7f8e5015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 -- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e500b3ec0 msgr2=0x7f8e500b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e500b3ec0 0x7f8e500b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 -- 172.21.15.114:0/3805201404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5015f3a0 con 0x7f8e500ce860 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e554fa640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e500b3ec0 0x7f8e500b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e54cf9640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 0x7f8e501505e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c410 tx=0x7f8e4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e400074e0 con 0x7f8e500ce860 2024-04-13T02:45:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e400047e0 con 0x7f8e500ce860 2024-04-13T02:45:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5015f680 con 0x7f8e500ce860 2024-04-13T02:45:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40004bd0 con 0x7f8e500ce860 2024-04-13T02:45:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.565+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5015fc40 con 0x7f8e500ce860 2024-04-13T02:45:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.566+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e500d3680 con 0x7f8e500ce860 2024-04-13T02:45:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.567+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e40011070 con 0x7f8e500ce860 2024-04-13T02:45:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.567+0000 7f8e45ffb640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e3406c920 0x7f8e3406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.567+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8e4008b780 con 0x7f8e500ce860 2024-04-13T02:45:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.567+0000 7f8e554fa640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e3406c920 0x7f8e3406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.568+0000 7f8e554fa640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e3406c920 0x7f8e3406ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c036000 tx=0x7f8e4c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.572+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e4000e280 con 0x7f8e500ce860 2024-04-13T02:45:31.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.743+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e5006e3c0 con 0x7f8e3406c920 2024-04-13T02:45:31.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.749+0000 7f8e45ffb640 1 -- 172.21.15.114:0/3805201404 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f8e5006e3c0 con 0x7f8e3406c920 2024-04-13T02:45:31.752 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:45:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e3406c920 msgr2=0x7f8e3406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e3406c920 0x7f8e3406ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c036000 tx=0x7f8e4c008030 comp rx=0 tx=0).stop 2024-04-13T02:45:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 msgr2=0x7f8e501505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 0x7f8e501505e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c410 tx=0x7f8e4000c8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 shutdown_connections 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e3406c920 0x7f8e3406ede0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8e5015edb0 0x7f8e5015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e500ce860 0x7f8e501505e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 --2- 172.21.15.114:0/3805201404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e500b3ec0 0x7f8e500b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 >> 172.21.15.114:0/3805201404 conn(0x7f8e500d27d0 msgr2=0x7f8e500c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 shutdown_connections 2024-04-13T02:45:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.752+0000 7f8e5775e640 1 -- 172.21.15.114:0/3805201404 wait complete. 2024-04-13T02:45:31.763 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-13T02:45:31.497321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.062977"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447920+0000","last_change":"2024-04-13T02:45:27.447920+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447920+0000","last_undegraded":"2024-04-13T02:45:27.447920+0000","last_fullsized":"2024-04-13T02:45:27.447920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447887+0000","last_change":"2024-04-13T02:45:27.447887+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447887+0000","last_undegraded":"2024-04-13T02:45:27.447887+0000","last_fullsized":"2024-04-13T02:45:27.447887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455265+0000","last_change":"2024-04-13T02:45:27.455265+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455265+0000","last_undegraded":"2024-04-13T02:45:27.455265+0000","last_fullsized":"2024-04-13T02:45:27.455265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448666+0000","last_change":"2024-04-13T02:45:27.448666+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448666+0000","last_undegraded":"2024-04-13T02:45:27.448666+0000","last_fullsized":"2024-04-13T02:45:27.448666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449012+0000","last_change":"2024-04-13T02:45:27.449012+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449012+0000","last_undegraded":"2024-04-13T02:45:27.449012+0000","last_fullsized":"2024-04-13T02:45:27.449012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447447+0000","last_change":"2024-04-13T02:45:27.447447+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447447+0000","last_undegraded":"2024-04-13T02:45:27.447447+0000","last_fullsized":"2024-04-13T02:45:27.447447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454677+0000","last_change":"2024-04-13T02:45:27.454677+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454677+0000","last_undegraded":"2024-04-13T02:45:27.454677+0000","last_fullsized":"2024-04-13T02:45:27.454677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454146+0000","last_change":"2024-04-13T02:45:27.454146+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454146+0000","last_undegraded":"2024-04-13T02:45:27.454146+0000","last_fullsized":"2024-04-13T02:45:27.454146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449888+0000","last_change":"2024-04-13T02:45:27.449888+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449888+0000","last_undegraded":"2024-04-13T02:45:27.449888+0000","last_fullsized":"2024-04-13T02:45:27.449888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448126+0000","last_change":"2024-04-13T02:45:27.448126+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448126+0000","last_undegraded":"2024-04-13T02:45:27.448126+0000","last_fullsized":"2024-04-13T02:45:27.448126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453139+0000","last_change":"2024-04-13T02:45:27.453139+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453139+0000","last_undegraded":"2024-04-13T02:45:27.453139+0000","last_fullsized":"2024-04-13T02:45:27.453139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454708+0000","last_change":"2024-04-13T02:45:27.454708+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454708+0000","last_undegraded":"2024-04-13T02:45:27.454708+0000","last_fullsized":"2024-04-13T02:45:27.454708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448573+0000","last_change":"2024-04-13T02:45:27.448573+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448573+0000","last_undegraded":"2024-04-13T02:45:27.448573+0000","last_fullsized":"2024-04-13T02:45:27.448573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446972+0000","last_change":"2024-04-13T02:45:27.446972+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446972+0000","last_undegraded":"2024-04-13T02:45:27.446972+0000","last_fullsized":"2024-04-13T02:45:27.446972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454032+0000","last_change":"2024-04-13T02:45:27.454032+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454032+0000","last_undegraded":"2024-04-13T02:45:27.454032+0000","last_fullsized":"2024-04-13T02:45:27.454032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453363+0000","last_change":"2024-04-13T02:45:27.453363+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453363+0000","last_undegraded":"2024-04-13T02:45:27.453363+0000","last_fullsized":"2024-04-13T02:45:27.453363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453654+0000","last_change":"2024-04-13T02:45:27.453654+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453654+0000","last_undegraded":"2024-04-13T02:45:27.453654+0000","last_fullsized":"2024-04-13T02:45:27.453654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447475+0000","last_change":"2024-04-13T02:45:27.447475+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447475+0000","last_undegraded":"2024-04-13T02:45:27.447475+0000","last_fullsized":"2024-04-13T02:45:27.447475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449070+0000","last_change":"2024-04-13T02:45:27.449070+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449070+0000","last_undegraded":"2024-04-13T02:45:27.449070+0000","last_fullsized":"2024-04-13T02:45:27.449070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450358+0000","last_change":"2024-04-13T02:45:27.450358+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450358+0000","last_undegraded":"2024-04-13T02:45:27.450358+0000","last_fullsized":"2024-04-13T02:45:27.450358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451958+0000","last_change":"2024-04-13T02:45:27.451958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451958+0000","last_undegraded":"2024-04-13T02:45:27.451958+0000","last_fullsized":"2024-04-13T02:45:27.451958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451088+0000","last_change":"2024-04-13T02:45:27.451088+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451088+0000","last_undegraded":"2024-04-13T02:45:27.451088+0000","last_fullsized":"2024-04-13T02:45:27.451088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447589+0000","last_change":"2024-04-13T02:45:27.447589+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447589+0000","last_undegraded":"2024-04-13T02:45:27.447589+0000","last_fullsized":"2024-04-13T02:45:27.447589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453531+0000","last_change":"2024-04-13T02:45:27.453531+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453531+0000","last_undegraded":"2024-04-13T02:45:27.453531+0000","last_fullsized":"2024-04-13T02:45:27.453531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447133+0000","last_change":"2024-04-13T02:45:27.447133+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447133+0000","last_undegraded":"2024-04-13T02:45:27.447133+0000","last_fullsized":"2024-04-13T02:45:27.447133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447034+0000","last_change":"2024-04-13T02:45:27.447034+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447034+0000","last_undegraded":"2024-04-13T02:45:27.447034+0000","last_fullsized":"2024-04-13T02:45:27.447034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448895+0000","last_change":"2024-04-13T02:45:27.448895+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448895+0000","last_undegraded":"2024-04-13T02:45:27.448895+0000","last_fullsized":"2024-04-13T02:45:27.448895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453593+0000","last_change":"2024-04-13T02:45:27.453593+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453593+0000","last_undegraded":"2024-04-13T02:45:27.453593+0000","last_fullsized":"2024-04-13T02:45:27.453593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451549+0000","last_change":"2024-04-13T02:45:27.451549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451549+0000","last_undegraded":"2024-04-13T02:45:27.451549+0000","last_fullsized":"2024-04-13T02:45:27.451549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452422+0000","last_change":"2024-04-13T02:45:27.452422+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452422+0000","last_undegraded":"2024-04-13T02:45:27.452422+0000","last_fullsized":"2024-04-13T02:45:27.452422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447806+0000","last_change":"2024-04-13T02:45:27.447806+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447806+0000","last_undegraded":"2024-04-13T02:45:27.447806+0000","last_fullsized":"2024-04-13T02:45:27.447806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451834+0000","last_change":"2024-04-13T02:45:27.451834+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451834+0000","last_undegraded":"2024-04-13T02:45:27.451834+0000","last_fullsized":"2024-04-13T02:45:27.451834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447569+0000","last_change":"2024-04-13T02:45:27.447569+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447569+0000","last_undegraded":"2024-04-13T02:45:27.447569+0000","last_fullsized":"2024-04-13T02:45:27.447569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462331+0000","last_change":"2024-04-13T02:45:27.459686+0000","last_active":"2024-04-13T02:45:27.462331+0000","last_peered":"2024-04-13T02:45:27.462331+0000","last_clean":"2024-04-13T02:45:27.462331+0000","last_became_active":"2024-04-13T02:45:27.459384+0000","last_became_peered":"2024-04-13T02:45:27.459384+0000","last_unstale":"2024-04-13T02:45:27.462331+0000","last_undegraded":"2024-04-13T02:45:27.462331+0000","last_fullsized":"2024-04-13T02:45:27.462331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447464+0000","last_change":"2024-04-13T02:45:27.447464+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447464+0000","last_undegraded":"2024-04-13T02:45:27.447464+0000","last_fullsized":"2024-04-13T02:45:27.447464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.457081+0000","last_change":"2024-04-13T02:45:27.456362+0000","last_active":"2024-04-13T02:45:27.457081+0000","last_peered":"2024-04-13T02:45:27.457081+0000","last_clean":"2024-04-13T02:45:27.457081+0000","last_became_active":"2024-04-13T02:45:27.456078+0000","last_became_peered":"2024-04-13T02:45:27.456078+0000","last_unstale":"2024-04-13T02:45:27.457081+0000","last_undegraded":"2024-04-13T02:45:27.457081+0000","last_fullsized":"2024-04-13T02:45:27.457081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451381+0000","last_change":"2024-04-13T02:45:27.451381+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451381+0000","last_undegraded":"2024-04-13T02:45:27.451381+0000","last_fullsized":"2024-04-13T02:45:27.451381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464937+0000","last_change":"2024-04-13T02:45:27.460638+0000","last_active":"2024-04-13T02:45:27.464937+0000","last_peered":"2024-04-13T02:45:27.464937+0000","last_clean":"2024-04-13T02:45:27.464937+0000","last_became_active":"2024-04-13T02:45:27.460344+0000","last_became_peered":"2024-04-13T02:45:27.460344+0000","last_unstale":"2024-04-13T02:45:27.464937+0000","last_undegraded":"2024-04-13T02:45:27.464937+0000","last_fullsized":"2024-04-13T02:45:27.464937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446549+0000","last_change":"2024-04-13T02:45:27.446549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446549+0000","last_undegraded":"2024-04-13T02:45:27.446549+0000","last_fullsized":"2024-04-13T02:45:27.446549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462289+0000","last_change":"2024-04-13T02:45:27.460024+0000","last_active":"2024-04-13T02:45:27.462289+0000","last_peered":"2024-04-13T02:45:27.462289+0000","last_clean":"2024-04-13T02:45:27.462289+0000","last_became_active":"2024-04-13T02:45:27.459710+0000","last_became_peered":"2024-04-13T02:45:27.459710+0000","last_unstale":"2024-04-13T02:45:27.462289+0000","last_undegraded":"2024-04-13T02:45:27.462289+0000","last_fullsized":"2024-04-13T02:45:27.462289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:23:16.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450455+0000","last_change":"2024-04-13T02:45:27.450455+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450455+0000","last_undegraded":"2024-04-13T02:45:27.450455+0000","last_fullsized":"2024-04-13T02:45:27.450455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460486+0000","last_change":"2024-04-13T02:45:27.458957+0000","last_active":"2024-04-13T02:45:27.460486+0000","last_peered":"2024-04-13T02:45:27.460486+0000","last_clean":"2024-04-13T02:45:27.460486+0000","last_became_active":"2024-04-13T02:45:27.458428+0000","last_became_peered":"2024-04-13T02:45:27.458428+0000","last_unstale":"2024-04-13T02:45:27.460486+0000","last_undegraded":"2024-04-13T02:45:27.460486+0000","last_fullsized":"2024-04-13T02:45:27.460486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:29:38.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453505+0000","last_change":"2024-04-13T02:45:27.453505+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453505+0000","last_undegraded":"2024-04-13T02:45:27.453505+0000","last_fullsized":"2024-04-13T02:45:27.453505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460516+0000","last_change":"2024-04-13T02:45:27.459153+0000","last_active":"2024-04-13T02:45:27.460516+0000","last_peered":"2024-04-13T02:45:27.460516+0000","last_clean":"2024-04-13T02:45:27.460516+0000","last_became_active":"2024-04-13T02:45:27.458853+0000","last_became_peered":"2024-04-13T02:45:27.458853+0000","last_unstale":"2024-04-13T02:45:27.460516+0000","last_undegraded":"2024-04-13T02:45:27.460516+0000","last_fullsized":"2024-04-13T02:45:27.460516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:51:22.207135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450302+0000","last_change":"2024-04-13T02:45:27.450302+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450302+0000","last_undegraded":"2024-04-13T02:45:27.450302+0000","last_fullsized":"2024-04-13T02:45:27.450302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464787+0000","last_change":"2024-04-13T02:45:27.457617+0000","last_active":"2024-04-13T02:45:27.464787+0000","last_peered":"2024-04-13T02:45:27.464787+0000","last_clean":"2024-04-13T02:45:27.464787+0000","last_became_active":"2024-04-13T02:45:27.457319+0000","last_became_peered":"2024-04-13T02:45:27.457319+0000","last_unstale":"2024-04-13T02:45:27.464787+0000","last_undegraded":"2024-04-13T02:45:27.464787+0000","last_fullsized":"2024-04-13T02:45:27.464787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446037+0000","last_change":"2024-04-13T02:45:27.446037+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446037+0000","last_undegraded":"2024-04-13T02:45:27.446037+0000","last_fullsized":"2024-04-13T02:45:27.446037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465195+0000","last_change":"2024-04-13T02:45:27.463132+0000","last_active":"2024-04-13T02:45:27.465195+0000","last_peered":"2024-04-13T02:45:27.465195+0000","last_clean":"2024-04-13T02:45:27.465195+0000","last_became_active":"2024-04-13T02:45:27.462833+0000","last_became_peered":"2024-04-13T02:45:27.462833+0000","last_unstale":"2024-04-13T02:45:27.465195+0000","last_undegraded":"2024-04-13T02:45:27.465195+0000","last_fullsized":"2024-04-13T02:45:27.465195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:10:33.583403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452371+0000","last_change":"2024-04-13T02:45:27.452371+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452371+0000","last_undegraded":"2024-04-13T02:45:27.452371+0000","last_fullsized":"2024-04-13T02:45:27.452371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462081+0000","last_change":"2024-04-13T02:45:27.456759+0000","last_active":"2024-04-13T02:45:27.462081+0000","last_peered":"2024-04-13T02:45:27.462081+0000","last_clean":"2024-04-13T02:45:27.462081+0000","last_became_active":"2024-04-13T02:45:27.456503+0000","last_became_peered":"2024-04-13T02:45:27.456503+0000","last_unstale":"2024-04-13T02:45:27.462081+0000","last_undegraded":"2024-04-13T02:45:27.462081+0000","last_fullsized":"2024-04-13T02:45:27.462081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:01:31.847609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450027+0000","last_change":"2024-04-13T02:45:27.450027+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450027+0000","last_undegraded":"2024-04-13T02:45:27.450027+0000","last_fullsized":"2024-04-13T02:45:27.450027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462361+0000","last_change":"2024-04-13T02:45:27.458838+0000","last_active":"2024-04-13T02:45:27.462361+0000","last_peered":"2024-04-13T02:45:27.462361+0000","last_clean":"2024-04-13T02:45:27.462361+0000","last_became_active":"2024-04-13T02:45:27.458520+0000","last_became_peered":"2024-04-13T02:45:27.458520+0000","last_unstale":"2024-04-13T02:45:27.462361+0000","last_undegraded":"2024-04-13T02:45:27.462361+0000","last_fullsized":"2024-04-13T02:45:27.462361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449541+0000","last_change":"2024-04-13T02:45:27.449541+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449541+0000","last_undegraded":"2024-04-13T02:45:27.449541+0000","last_fullsized":"2024-04-13T02:45:27.449541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464181+0000","last_change":"2024-04-13T02:45:27.463079+0000","last_active":"2024-04-13T02:45:27.464181+0000","last_peered":"2024-04-13T02:45:27.464181+0000","last_clean":"2024-04-13T02:45:27.464181+0000","last_became_active":"2024-04-13T02:45:27.461886+0000","last_became_peered":"2024-04-13T02:45:27.461886+0000","last_unstale":"2024-04-13T02:45:27.464181+0000","last_undegraded":"2024-04-13T02:45:27.464181+0000","last_fullsized":"2024-04-13T02:45:27.464181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455683+0000","last_change":"2024-04-13T02:45:27.455683+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455683+0000","last_undegraded":"2024-04-13T02:45:27.455683+0000","last_fullsized":"2024-04-13T02:45:27.455683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464924+0000","last_change":"2024-04-13T02:45:27.460661+0000","last_active":"2024-04-13T02:45:27.464924+0000","last_peered":"2024-04-13T02:45:27.464924+0000","last_clean":"2024-04-13T02:45:27.464924+0000","last_became_active":"2024-04-13T02:45:27.460173+0000","last_became_peered":"2024-04-13T02:45:27.460173+0000","last_unstale":"2024-04-13T02:45:27.464924+0000","last_undegraded":"2024-04-13T02:45:27.464924+0000","last_fullsized":"2024-04-13T02:45:27.464924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:52.554776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446026+0000","last_change":"2024-04-13T02:45:27.446026+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446026+0000","last_undegraded":"2024-04-13T02:45:27.446026+0000","last_fullsized":"2024-04-13T02:45:27.446026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465212+0000","last_change":"2024-04-13T02:45:27.463704+0000","last_active":"2024-04-13T02:45:27.465212+0000","last_peered":"2024-04-13T02:45:27.465212+0000","last_clean":"2024-04-13T02:45:27.465212+0000","last_became_active":"2024-04-13T02:45:27.463451+0000","last_became_peered":"2024-04-13T02:45:27.463451+0000","last_unstale":"2024-04-13T02:45:27.465212+0000","last_undegraded":"2024-04-13T02:45:27.465212+0000","last_fullsized":"2024-04-13T02:45:27.465212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:31:03.954328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449471+0000","last_change":"2024-04-13T02:45:27.449471+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449471+0000","last_undegraded":"2024-04-13T02:45:27.449471+0000","last_fullsized":"2024-04-13T02:45:27.449471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.459655+0000","last_change":"2024-04-13T02:45:27.455259+0000","last_active":"2024-04-13T02:45:27.459655+0000","last_peered":"2024-04-13T02:45:27.459655+0000","last_clean":"2024-04-13T02:45:27.459655+0000","last_became_active":"2024-04-13T02:45:27.454963+0000","last_became_peered":"2024-04-13T02:45:27.454963+0000","last_unstale":"2024-04-13T02:45:27.459655+0000","last_undegraded":"2024-04-13T02:45:27.459655+0000","last_fullsized":"2024-04-13T02:45:27.459655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449030+0000","last_change":"2024-04-13T02:45:27.449030+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449030+0000","last_undegraded":"2024-04-13T02:45:27.449030+0000","last_fullsized":"2024-04-13T02:45:27.449030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462043+0000","last_change":"2024-04-13T02:45:27.456096+0000","last_active":"2024-04-13T02:45:27.462043+0000","last_peered":"2024-04-13T02:45:27.462043+0000","last_clean":"2024-04-13T02:45:27.462043+0000","last_became_active":"2024-04-13T02:45:27.455814+0000","last_became_peered":"2024-04-13T02:45:27.455814+0000","last_unstale":"2024-04-13T02:45:27.462043+0000","last_undegraded":"2024-04-13T02:45:27.462043+0000","last_fullsized":"2024-04-13T02:45:27.462043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:04:37.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447254+0000","last_change":"2024-04-13T02:45:27.447254+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447254+0000","last_undegraded":"2024-04-13T02:45:27.447254+0000","last_fullsized":"2024-04-13T02:45:27.447254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464950+0000","last_change":"2024-04-13T02:45:27.461165+0000","last_active":"2024-04-13T02:45:27.464950+0000","last_peered":"2024-04-13T02:45:27.464950+0000","last_clean":"2024-04-13T02:45:27.464950+0000","last_became_active":"2024-04-13T02:45:27.460919+0000","last_became_peered":"2024-04-13T02:45:27.460919+0000","last_unstale":"2024-04-13T02:45:27.464950+0000","last_undegraded":"2024-04-13T02:45:27.464950+0000","last_fullsized":"2024-04-13T02:45:27.464950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:42.420394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449963+0000","last_change":"2024-04-13T02:45:27.449963+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449963+0000","last_undegraded":"2024-04-13T02:45:27.449963+0000","last_fullsized":"2024-04-13T02:45:27.449963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462227+0000","last_change":"2024-04-13T02:45:27.456385+0000","last_active":"2024-04-13T02:45:27.462227+0000","last_peered":"2024-04-13T02:45:27.462227+0000","last_clean":"2024-04-13T02:45:27.462227+0000","last_became_active":"2024-04-13T02:45:27.456119+0000","last_became_peered":"2024-04-13T02:45:27.456119+0000","last_unstale":"2024-04-13T02:45:27.462227+0000","last_undegraded":"2024-04-13T02:45:27.462227+0000","last_fullsized":"2024-04-13T02:45:27.462227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456905+0000","last_change":"2024-04-13T02:45:27.456905+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456905+0000","last_undegraded":"2024-04-13T02:45:27.456905+0000","last_fullsized":"2024-04-13T02:45:27.456905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464275+0000","last_change":"2024-04-13T02:45:27.462257+0000","last_active":"2024-04-13T02:45:27.464275+0000","last_peered":"2024-04-13T02:45:27.464275+0000","last_clean":"2024-04-13T02:45:27.464275+0000","last_became_active":"2024-04-13T02:45:27.461973+0000","last_became_peered":"2024-04-13T02:45:27.461973+0000","last_unstale":"2024-04-13T02:45:27.464275+0000","last_undegraded":"2024-04-13T02:45:27.464275+0000","last_fullsized":"2024-04-13T02:45:27.464275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:53:32.487804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446021+0000","last_change":"2024-04-13T02:45:27.446021+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446021+0000","last_undegraded":"2024-04-13T02:45:27.446021+0000","last_fullsized":"2024-04-13T02:45:27.446021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465172+0000","last_change":"2024-04-13T02:45:27.463019+0000","last_active":"2024-04-13T02:45:27.465172+0000","last_peered":"2024-04-13T02:45:27.465172+0000","last_clean":"2024-04-13T02:45:27.465172+0000","last_became_active":"2024-04-13T02:45:27.462366+0000","last_became_peered":"2024-04-13T02:45:27.462366+0000","last_unstale":"2024-04-13T02:45:27.465172+0000","last_undegraded":"2024-04-13T02:45:27.465172+0000","last_fullsized":"2024-04-13T02:45:27.465172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:39:25.055157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451008+0000","last_change":"2024-04-13T02:45:27.451008+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451008+0000","last_undegraded":"2024-04-13T02:45:27.451008+0000","last_fullsized":"2024-04-13T02:45:27.451008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465174+0000","last_change":"2024-04-13T02:45:27.463016+0000","last_active":"2024-04-13T02:45:27.465174+0000","last_peered":"2024-04-13T02:45:27.465174+0000","last_clean":"2024-04-13T02:45:27.465174+0000","last_became_active":"2024-04-13T02:45:27.462717+0000","last_became_peered":"2024-04-13T02:45:27.462717+0000","last_unstale":"2024-04-13T02:45:27.465174+0000","last_undegraded":"2024-04-13T02:45:27.465174+0000","last_fullsized":"2024-04-13T02:45:27.465174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:18:15.566653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447467+0000","last_change":"2024-04-13T02:45:27.447467+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447467+0000","last_undegraded":"2024-04-13T02:45:27.447467+0000","last_fullsized":"2024-04-13T02:45:27.447467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.458459+0000","last_change":"2024-04-13T02:45:27.457724+0000","last_active":"2024-04-13T02:45:27.458459+0000","last_peered":"2024-04-13T02:45:27.458459+0000","last_clean":"2024-04-13T02:45:27.458459+0000","last_became_active":"2024-04-13T02:45:27.457432+0000","last_became_peered":"2024-04-13T02:45:27.457432+0000","last_unstale":"2024-04-13T02:45:27.458459+0000","last_undegraded":"2024-04-13T02:45:27.458459+0000","last_fullsized":"2024-04-13T02:45:27.458459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448118+0000","last_change":"2024-04-13T02:45:27.448118+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448118+0000","last_undegraded":"2024-04-13T02:45:27.448118+0000","last_fullsized":"2024-04-13T02:45:27.448118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462616+0000","last_change":"2024-04-13T02:45:27.460601+0000","last_active":"2024-04-13T02:45:27.462616+0000","last_peered":"2024-04-13T02:45:27.462616+0000","last_clean":"2024-04-13T02:45:27.462616+0000","last_became_active":"2024-04-13T02:45:27.460291+0000","last_became_peered":"2024-04-13T02:45:27.460291+0000","last_unstale":"2024-04-13T02:45:27.462616+0000","last_undegraded":"2024-04-13T02:45:27.462616+0000","last_fullsized":"2024-04-13T02:45:27.462616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450965+0000","last_change":"2024-04-13T02:45:27.450965+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450965+0000","last_undegraded":"2024-04-13T02:45:27.450965+0000","last_fullsized":"2024-04-13T02:45:27.450965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460959+0000","last_change":"2024-04-13T02:45:27.460370+0000","last_active":"2024-04-13T02:45:27.460959+0000","last_peered":"2024-04-13T02:45:27.460959+0000","last_clean":"2024-04-13T02:45:27.460959+0000","last_became_active":"2024-04-13T02:45:27.460094+0000","last_became_peered":"2024-04-13T02:45:27.460094+0000","last_unstale":"2024-04-13T02:45:27.460959+0000","last_undegraded":"2024-04-13T02:45:27.460959+0000","last_fullsized":"2024-04-13T02:45:27.460959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:53.178316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449120+0000","last_change":"2024-04-13T02:45:27.449120+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449120+0000","last_undegraded":"2024-04-13T02:45:27.449120+0000","last_fullsized":"2024-04-13T02:45:27.449120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.463557+0000","last_change":"2024-04-13T02:45:27.461869+0000","last_active":"2024-04-13T02:45:27.463557+0000","last_peered":"2024-04-13T02:45:27.463557+0000","last_clean":"2024-04-13T02:45:27.463557+0000","last_became_active":"2024-04-13T02:45:27.461565+0000","last_became_peered":"2024-04-13T02:45:27.461565+0000","last_unstale":"2024-04-13T02:45:27.463557+0000","last_undegraded":"2024-04-13T02:45:27.463557+0000","last_fullsized":"2024-04-13T02:45:27.463557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450936+0000","last_change":"2024-04-13T02:45:27.450936+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450936+0000","last_undegraded":"2024-04-13T02:45:27.450936+0000","last_fullsized":"2024-04-13T02:45:27.450936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462542+0000","last_change":"2024-04-13T02:45:27.459353+0000","last_active":"2024-04-13T02:45:27.462542+0000","last_peered":"2024-04-13T02:45:27.462542+0000","last_clean":"2024-04-13T02:45:27.462542+0000","last_became_active":"2024-04-13T02:45:27.459099+0000","last_became_peered":"2024-04-13T02:45:27.459099+0000","last_unstale":"2024-04-13T02:45:27.462542+0000","last_undegraded":"2024-04-13T02:45:27.462542+0000","last_fullsized":"2024-04-13T02:45:27.462542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456493+0000","last_change":"2024-04-13T02:45:27.456493+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456493+0000","last_undegraded":"2024-04-13T02:45:27.456493+0000","last_fullsized":"2024-04-13T02:45:27.456493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.454193+0000","last_change":"2024-04-13T02:45:27.453586+0000","last_active":"2024-04-13T02:45:27.454193+0000","last_peered":"2024-04-13T02:45:27.454193+0000","last_clean":"2024-04-13T02:45:27.454193+0000","last_became_active":"2024-04-13T02:45:27.453276+0000","last_became_peered":"2024-04-13T02:45:27.453276+0000","last_unstale":"2024-04-13T02:45:27.454193+0000","last_undegraded":"2024-04-13T02:45:27.454193+0000","last_fullsized":"2024-04-13T02:45:27.454193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446976+0000","last_change":"2024-04-13T02:45:27.446976+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446976+0000","last_undegraded":"2024-04-13T02:45:27.446976+0000","last_fullsized":"2024-04-13T02:45:27.446976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462322+0000","last_change":"2024-04-13T02:45:27.456466+0000","last_active":"2024-04-13T02:45:27.462322+0000","last_peered":"2024-04-13T02:45:27.462322+0000","last_clean":"2024-04-13T02:45:27.462322+0000","last_became_active":"2024-04-13T02:45:27.456102+0000","last_became_peered":"2024-04-13T02:45:27.456102+0000","last_unstale":"2024-04-13T02:45:27.462322+0000","last_undegraded":"2024-04-13T02:45:27.462322+0000","last_fullsized":"2024-04-13T02:45:27.462322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447740+0000","last_change":"2024-04-13T02:45:27.447740+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447740+0000","last_undegraded":"2024-04-13T02:45:27.447740+0000","last_fullsized":"2024-04-13T02:45:27.447740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462244+0000","last_change":"2024-04-13T02:45:27.458418+0000","last_active":"2024-04-13T02:45:27.462244+0000","last_peered":"2024-04-13T02:45:27.462244+0000","last_clean":"2024-04-13T02:45:27.462244+0000","last_became_active":"2024-04-13T02:45:27.458118+0000","last_became_peered":"2024-04-13T02:45:27.458118+0000","last_unstale":"2024-04-13T02:45:27.462244+0000","last_undegraded":"2024-04-13T02:45:27.462244+0000","last_fullsized":"2024-04-13T02:45:27.462244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447941+0000","last_change":"2024-04-13T02:45:27.447941+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447941+0000","last_undegraded":"2024-04-13T02:45:27.447941+0000","last_fullsized":"2024-04-13T02:45:27.447941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462292+0000","last_change":"2024-04-13T02:45:27.458631+0000","last_active":"2024-04-13T02:45:27.462292+0000","last_peered":"2024-04-13T02:45:27.462292+0000","last_clean":"2024-04-13T02:45:27.462292+0000","last_became_active":"2024-04-13T02:45:27.458346+0000","last_became_peered":"2024-04-13T02:45:27.458346+0000","last_unstale":"2024-04-13T02:45:27.462292+0000","last_undegraded":"2024-04-13T02:45:27.462292+0000","last_fullsized":"2024-04-13T02:45:27.462292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449799+0000","last_change":"2024-04-13T02:45:27.449799+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449799+0000","last_undegraded":"2024-04-13T02:45:27.449799+0000","last_fullsized":"2024-04-13T02:45:27.449799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460530+0000","last_change":"2024-04-13T02:45:27.459295+0000","last_active":"2024-04-13T02:45:27.460530+0000","last_peered":"2024-04-13T02:45:27.460530+0000","last_clean":"2024-04-13T02:45:27.460530+0000","last_became_active":"2024-04-13T02:45:27.459013+0000","last_became_peered":"2024-04-13T02:45:27.459013+0000","last_unstale":"2024-04-13T02:45:27.460530+0000","last_undegraded":"2024-04-13T02:45:27.460530+0000","last_fullsized":"2024-04-13T02:45:27.460530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:57:33.753742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449958+0000","last_change":"2024-04-13T02:45:27.449958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449958+0000","last_undegraded":"2024-04-13T02:45:27.449958+0000","last_fullsized":"2024-04-13T02:45:27.449958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462088+0000","last_change":"2024-04-13T02:45:27.455763+0000","last_active":"2024-04-13T02:45:27.462088+0000","last_peered":"2024-04-13T02:45:27.462088+0000","last_clean":"2024-04-13T02:45:27.462088+0000","last_became_active":"2024-04-13T02:45:27.455501+0000","last_became_peered":"2024-04-13T02:45:27.455501+0000","last_unstale":"2024-04-13T02:45:27.462088+0000","last_undegraded":"2024-04-13T02:45:27.462088+0000","last_fullsized":"2024-04-13T02:45:27.462088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:14:18.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449262+0000","last_change":"2024-04-13T02:45:27.449262+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449262+0000","last_undegraded":"2024-04-13T02:45:27.449262+0000","last_fullsized":"2024-04-13T02:45:27.449262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462291+0000","last_change":"2024-04-13T02:45:27.457081+0000","last_active":"2024-04-13T02:45:27.462291+0000","last_peered":"2024-04-13T02:45:27.462291+0000","last_clean":"2024-04-13T02:45:27.462291+0000","last_became_active":"2024-04-13T02:45:27.456809+0000","last_became_peered":"2024-04-13T02:45:27.456809+0000","last_unstale":"2024-04-13T02:45:27.462291+0000","last_undegraded":"2024-04-13T02:45:27.462291+0000","last_fullsized":"2024-04-13T02:45:27.462291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.449801+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:45:27.449801+0000","last_peered":"2024-04-13T02:45:27.449801+0000","last_clean":"2024-04-13T02:45:27.449801+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:45:27.449801+0000","last_undegraded":"2024-04-13T02:45:27.449801+0000","last_fullsized":"2024-04-13T02:45:27.449801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:45:31.768 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:45:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.904+0000 7f1534c36640 1 Processor -- start 2024-04-13T02:45:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.905+0000 7f1534c36640 1 -- start start 2024-04-13T02:45:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.905+0000 7f1534c36640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15301461f0 0x7f15300ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.905+0000 7f1534c36640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 0x7f15300b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.905+0000 7f1534c36640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15300b4be0 con 0x7f15300b3e10 2024-04-13T02:45:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.905+0000 7f1534c36640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f15300a9640 con 0x7f15301461f0 2024-04-13T02:45:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.905+0000 7f1534c36640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f15300cf250 con 0x7f15300cedf0 2024-04-13T02:45:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f15300b3e10 0x7f15300cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44914/0 (socket says 172.21.15.114:44914) 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152ed9d640 1 -- 172.21.15.114:0/2247957870 learned_addr learned my addr 172.21.15.114:0/2247957870 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152e59c640 1 --2- 172.21.15.114:0/2247957870 >> v2:172.21.15.130:3300/0 conn(0x7f15301461f0 0x7f15300ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 0x7f15300b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075094980 0 0) 0x7f15300b4be0 con 0x7f15300b3e10 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1518003520 con 0x7f15300b3e10 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1150006350 0 0) 0x7f1518003520 con 0x7f15300b3e10 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 msgr2=0x7f15300b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 0x7f15300b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 >> v2:172.21.15.130:3300/0 conn(0x7f15301461f0 msgr2=0x7f15300ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 --2- 172.21.15.114:0/2247957870 >> v2:172.21.15.130:3300/0 conn(0x7f15301461f0 0x7f15300ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15300b4620 con 0x7f15300b3e10 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f15280019f0 con 0x7f15300b3e10 2024-04-13T02:45:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 >> v1:172.21.15.114:6789/0 conn(0x7f15300b3e10 legacy=0x7f15300cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15180039b0 0x7f1518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1518004800 0x7f1518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 0x7f15180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f151800b9c0 con 0x7f1518004800 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f151800bb40 con 0x7f15180039b0 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f151800bcc0 con 0x7f15300cedf0 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1518004800 0x7f1518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152e59c640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15180039b0 0x7f1518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.906+0000 7f152ed9d640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 0x7f15180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152dd9b640 1 -- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 msgr2=0x7f15180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15300cedf0 0x7f15180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152dd9b640 1 -- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15180039b0 msgr2=0x7f1518003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15180039b0 0x7f1518003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152dd9b640 1 -- 172.21.15.114:0/2247957870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518003520 con 0x7f1518004800 2024-04-13T02:45:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1518004800 0x7f1518004c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1520009ac0 tx=0x7f1518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b869b8df68350fe server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520039070 con 0x7f1518004800 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.907+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152002c6b0 con 0x7f1518004800 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f152d59a640 1 -- 172.21.15.114:0/2247957870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520009690 con 0x7f1518004800 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f1534c36640 1 -- 172.21.15.114:0/2247957870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1518004800 msgr2=0x7f1518004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f1534c36640 1 --2- 172.21.15.114:0/2247957870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1518004800 0x7f1518004c80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1520009ac0 tx=0x7f1518005830 comp rx=0 tx=0).stop 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f152ed9d640 1 -- 172.21.15.114:0/2247957870 reap_dead start 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f1534c36640 1 -- 172.21.15.114:0/2247957870 shutdown_connections 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f1534c36640 1 -- 172.21.15.114:0/2247957870 >> 172.21.15.114:0/2247957870 conn(0x7f15300b27b0 msgr2=0x7f15300b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f1534c36640 1 -- 172.21.15.114:0/2247957870 shutdown_connections 2024-04-13T02:45:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.908+0000 7f1534c36640 1 -- 172.21.15.114:0/2247957870 wait complete. 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.909+0000 7f1534c36640 1 Processor -- start 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.909+0000 7f1534c36640 1 -- start start 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f1534c36640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1518004800 0x7f15301551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f1534c36640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 0x7f153006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f1534c36640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1530141bc0 0x7f1530142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f1534c36640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f153015d290 con 0x7f153006e240 2024-04-13T02:45:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f1534c36640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f153015cfb0 con 0x7f1530141bc0 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f1534c36640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f15301465d0 con 0x7f1518004800 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f152dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 0x7f153006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f152dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 0x7f153006e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43192/0 (socket says 172.21.15.114:43192) 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.910+0000 7f152dd9b640 1 -- 172.21.15.114:0/2284355910 learned_addr learned my addr 172.21.15.114:0/2284355910 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f152dd9b640 1 -- 172.21.15.114:0/2284355910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1518004800 msgr2=0x7f15301551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1518004800 0x7f15301551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f152dd9b640 1 -- 172.21.15.114:0/2284355910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1530141bc0 msgr2=0x7f1530142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1530141bc0 0x7f1530142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f152dd9b640 1 -- 172.21.15.114:0/2284355910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153015c310 con 0x7f153006e240 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f152dd9b640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 0x7f153006e6c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1520037040 tx=0x7f1520004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520039050 con 0x7f153006e240 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520045070 con 0x7f153006e240 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520003850 con 0x7f153006e240 2024-04-13T02:45:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153006ee20 con 0x7f153006e240 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.911+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153006f3e0 con 0x7f153006e240 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.912+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1530068c80 con 0x7f153006e240 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.912+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15200039f0 con 0x7f153006e240 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.913+0000 7f151effd640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f151006c8f0 0x7f151006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.913+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f15200ad580 con 0x7f153006e240 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.913+0000 7f152e59c640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f151006c8f0 0x7f151006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.913+0000 7f152e59c640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f151006c8f0 0x7f151006edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1524006b10 tx=0x7f1524006aa0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:31.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:31.917+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f152004e020 con 0x7f153006e240 2024-04-13T02:45:32.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.089+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15300c6210 con 0x7f151006c8f0 2024-04-13T02:45:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.095+0000 7f151effd640 1 -- 172.21.15.114:0/2284355910 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f15300c6210 con 0x7f151006c8f0 2024-04-13T02:45:32.098 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f151006c8f0 msgr2=0x7f151006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f151006c8f0 0x7f151006edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1524006b10 tx=0x7f1524006aa0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 msgr2=0x7f153006e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 0x7f153006e6c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1520037040 tx=0x7f1520004730 comp rx=0 tx=0).stop 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 shutdown_connections 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1530141bc0 0x7f1530142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f153006e240 0x7f153006e6c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f151006c8f0 0x7f151006edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 --2- 172.21.15.114:0/2284355910 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1518004800 0x7f15301551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 >> 172.21.15.114:0/2284355910 conn(0x7f15300b27b0 msgr2=0x7f15300721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:32.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 shutdown_connections 2024-04-13T02:45:32.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.098+0000 7f1534c36640 1 -- 172.21.15.114:0/2284355910 wait complete. 2024-04-13T02:45:32.109 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-13T02:45:31.497321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.062977"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447920+0000","last_change":"2024-04-13T02:45:27.447920+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447920+0000","last_undegraded":"2024-04-13T02:45:27.447920+0000","last_fullsized":"2024-04-13T02:45:27.447920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447887+0000","last_change":"2024-04-13T02:45:27.447887+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447887+0000","last_undegraded":"2024-04-13T02:45:27.447887+0000","last_fullsized":"2024-04-13T02:45:27.447887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455265+0000","last_change":"2024-04-13T02:45:27.455265+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455265+0000","last_undegraded":"2024-04-13T02:45:27.455265+0000","last_fullsized":"2024-04-13T02:45:27.455265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448666+0000","last_change":"2024-04-13T02:45:27.448666+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448666+0000","last_undegraded":"2024-04-13T02:45:27.448666+0000","last_fullsized":"2024-04-13T02:45:27.448666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449012+0000","last_change":"2024-04-13T02:45:27.449012+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449012+0000","last_undegraded":"2024-04-13T02:45:27.449012+0000","last_fullsized":"2024-04-13T02:45:27.449012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447447+0000","last_change":"2024-04-13T02:45:27.447447+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447447+0000","last_undegraded":"2024-04-13T02:45:27.447447+0000","last_fullsized":"2024-04-13T02:45:27.447447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454677+0000","last_change":"2024-04-13T02:45:27.454677+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454677+0000","last_undegraded":"2024-04-13T02:45:27.454677+0000","last_fullsized":"2024-04-13T02:45:27.454677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454146+0000","last_change":"2024-04-13T02:45:27.454146+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454146+0000","last_undegraded":"2024-04-13T02:45:27.454146+0000","last_fullsized":"2024-04-13T02:45:27.454146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449888+0000","last_change":"2024-04-13T02:45:27.449888+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449888+0000","last_undegraded":"2024-04-13T02:45:27.449888+0000","last_fullsized":"2024-04-13T02:45:27.449888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448126+0000","last_change":"2024-04-13T02:45:27.448126+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448126+0000","last_undegraded":"2024-04-13T02:45:27.448126+0000","last_fullsized":"2024-04-13T02:45:27.448126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453139+0000","last_change":"2024-04-13T02:45:27.453139+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453139+0000","last_undegraded":"2024-04-13T02:45:27.453139+0000","last_fullsized":"2024-04-13T02:45:27.453139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454708+0000","last_change":"2024-04-13T02:45:27.454708+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454708+0000","last_undegraded":"2024-04-13T02:45:27.454708+0000","last_fullsized":"2024-04-13T02:45:27.454708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448573+0000","last_change":"2024-04-13T02:45:27.448573+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448573+0000","last_undegraded":"2024-04-13T02:45:27.448573+0000","last_fullsized":"2024-04-13T02:45:27.448573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446972+0000","last_change":"2024-04-13T02:45:27.446972+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446972+0000","last_undegraded":"2024-04-13T02:45:27.446972+0000","last_fullsized":"2024-04-13T02:45:27.446972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454032+0000","last_change":"2024-04-13T02:45:27.454032+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454032+0000","last_undegraded":"2024-04-13T02:45:27.454032+0000","last_fullsized":"2024-04-13T02:45:27.454032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453363+0000","last_change":"2024-04-13T02:45:27.453363+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453363+0000","last_undegraded":"2024-04-13T02:45:27.453363+0000","last_fullsized":"2024-04-13T02:45:27.453363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453654+0000","last_change":"2024-04-13T02:45:27.453654+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453654+0000","last_undegraded":"2024-04-13T02:45:27.453654+0000","last_fullsized":"2024-04-13T02:45:27.453654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447475+0000","last_change":"2024-04-13T02:45:27.447475+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447475+0000","last_undegraded":"2024-04-13T02:45:27.447475+0000","last_fullsized":"2024-04-13T02:45:27.447475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449070+0000","last_change":"2024-04-13T02:45:27.449070+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449070+0000","last_undegraded":"2024-04-13T02:45:27.449070+0000","last_fullsized":"2024-04-13T02:45:27.449070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450358+0000","last_change":"2024-04-13T02:45:27.450358+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450358+0000","last_undegraded":"2024-04-13T02:45:27.450358+0000","last_fullsized":"2024-04-13T02:45:27.450358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451958+0000","last_change":"2024-04-13T02:45:27.451958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451958+0000","last_undegraded":"2024-04-13T02:45:27.451958+0000","last_fullsized":"2024-04-13T02:45:27.451958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451088+0000","last_change":"2024-04-13T02:45:27.451088+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451088+0000","last_undegraded":"2024-04-13T02:45:27.451088+0000","last_fullsized":"2024-04-13T02:45:27.451088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447589+0000","last_change":"2024-04-13T02:45:27.447589+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447589+0000","last_undegraded":"2024-04-13T02:45:27.447589+0000","last_fullsized":"2024-04-13T02:45:27.447589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453531+0000","last_change":"2024-04-13T02:45:27.453531+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453531+0000","last_undegraded":"2024-04-13T02:45:27.453531+0000","last_fullsized":"2024-04-13T02:45:27.453531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447133+0000","last_change":"2024-04-13T02:45:27.447133+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447133+0000","last_undegraded":"2024-04-13T02:45:27.447133+0000","last_fullsized":"2024-04-13T02:45:27.447133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447034+0000","last_change":"2024-04-13T02:45:27.447034+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447034+0000","last_undegraded":"2024-04-13T02:45:27.447034+0000","last_fullsized":"2024-04-13T02:45:27.447034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448895+0000","last_change":"2024-04-13T02:45:27.448895+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448895+0000","last_undegraded":"2024-04-13T02:45:27.448895+0000","last_fullsized":"2024-04-13T02:45:27.448895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453593+0000","last_change":"2024-04-13T02:45:27.453593+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453593+0000","last_undegraded":"2024-04-13T02:45:27.453593+0000","last_fullsized":"2024-04-13T02:45:27.453593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451549+0000","last_change":"2024-04-13T02:45:27.451549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451549+0000","last_undegraded":"2024-04-13T02:45:27.451549+0000","last_fullsized":"2024-04-13T02:45:27.451549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452422+0000","last_change":"2024-04-13T02:45:27.452422+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452422+0000","last_undegraded":"2024-04-13T02:45:27.452422+0000","last_fullsized":"2024-04-13T02:45:27.452422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447806+0000","last_change":"2024-04-13T02:45:27.447806+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447806+0000","last_undegraded":"2024-04-13T02:45:27.447806+0000","last_fullsized":"2024-04-13T02:45:27.447806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451834+0000","last_change":"2024-04-13T02:45:27.451834+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451834+0000","last_undegraded":"2024-04-13T02:45:27.451834+0000","last_fullsized":"2024-04-13T02:45:27.451834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447569+0000","last_change":"2024-04-13T02:45:27.447569+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447569+0000","last_undegraded":"2024-04-13T02:45:27.447569+0000","last_fullsized":"2024-04-13T02:45:27.447569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462331+0000","last_change":"2024-04-13T02:45:27.459686+0000","last_active":"2024-04-13T02:45:27.462331+0000","last_peered":"2024-04-13T02:45:27.462331+0000","last_clean":"2024-04-13T02:45:27.462331+0000","last_became_active":"2024-04-13T02:45:27.459384+0000","last_became_peered":"2024-04-13T02:45:27.459384+0000","last_unstale":"2024-04-13T02:45:27.462331+0000","last_undegraded":"2024-04-13T02:45:27.462331+0000","last_fullsized":"2024-04-13T02:45:27.462331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447464+0000","last_change":"2024-04-13T02:45:27.447464+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447464+0000","last_undegraded":"2024-04-13T02:45:27.447464+0000","last_fullsized":"2024-04-13T02:45:27.447464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.457081+0000","last_change":"2024-04-13T02:45:27.456362+0000","last_active":"2024-04-13T02:45:27.457081+0000","last_peered":"2024-04-13T02:45:27.457081+0000","last_clean":"2024-04-13T02:45:27.457081+0000","last_became_active":"2024-04-13T02:45:27.456078+0000","last_became_peered":"2024-04-13T02:45:27.456078+0000","last_unstale":"2024-04-13T02:45:27.457081+0000","last_undegraded":"2024-04-13T02:45:27.457081+0000","last_fullsized":"2024-04-13T02:45:27.457081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451381+0000","last_change":"2024-04-13T02:45:27.451381+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451381+0000","last_undegraded":"2024-04-13T02:45:27.451381+0000","last_fullsized":"2024-04-13T02:45:27.451381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464937+0000","last_change":"2024-04-13T02:45:27.460638+0000","last_active":"2024-04-13T02:45:27.464937+0000","last_peered":"2024-04-13T02:45:27.464937+0000","last_clean":"2024-04-13T02:45:27.464937+0000","last_became_active":"2024-04-13T02:45:27.460344+0000","last_became_peered":"2024-04-13T02:45:27.460344+0000","last_unstale":"2024-04-13T02:45:27.464937+0000","last_undegraded":"2024-04-13T02:45:27.464937+0000","last_fullsized":"2024-04-13T02:45:27.464937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446549+0000","last_change":"2024-04-13T02:45:27.446549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446549+0000","last_undegraded":"2024-04-13T02:45:27.446549+0000","last_fullsized":"2024-04-13T02:45:27.446549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462289+0000","last_change":"2024-04-13T02:45:27.460024+0000","last_active":"2024-04-13T02:45:27.462289+0000","last_peered":"2024-04-13T02:45:27.462289+0000","last_clean":"2024-04-13T02:45:27.462289+0000","last_became_active":"2024-04-13T02:45:27.459710+0000","last_became_peered":"2024-04-13T02:45:27.459710+0000","last_unstale":"2024-04-13T02:45:27.462289+0000","last_undegraded":"2024-04-13T02:45:27.462289+0000","last_fullsized":"2024-04-13T02:45:27.462289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:23:16.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450455+0000","last_change":"2024-04-13T02:45:27.450455+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450455+0000","last_undegraded":"2024-04-13T02:45:27.450455+0000","last_fullsized":"2024-04-13T02:45:27.450455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460486+0000","last_change":"2024-04-13T02:45:27.458957+0000","last_active":"2024-04-13T02:45:27.460486+0000","last_peered":"2024-04-13T02:45:27.460486+0000","last_clean":"2024-04-13T02:45:27.460486+0000","last_became_active":"2024-04-13T02:45:27.458428+0000","last_became_peered":"2024-04-13T02:45:27.458428+0000","last_unstale":"2024-04-13T02:45:27.460486+0000","last_undegraded":"2024-04-13T02:45:27.460486+0000","last_fullsized":"2024-04-13T02:45:27.460486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:29:38.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453505+0000","last_change":"2024-04-13T02:45:27.453505+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453505+0000","last_undegraded":"2024-04-13T02:45:27.453505+0000","last_fullsized":"2024-04-13T02:45:27.453505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460516+0000","last_change":"2024-04-13T02:45:27.459153+0000","last_active":"2024-04-13T02:45:27.460516+0000","last_peered":"2024-04-13T02:45:27.460516+0000","last_clean":"2024-04-13T02:45:27.460516+0000","last_became_active":"2024-04-13T02:45:27.458853+0000","last_became_peered":"2024-04-13T02:45:27.458853+0000","last_unstale":"2024-04-13T02:45:27.460516+0000","last_undegraded":"2024-04-13T02:45:27.460516+0000","last_fullsized":"2024-04-13T02:45:27.460516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:51:22.207135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450302+0000","last_change":"2024-04-13T02:45:27.450302+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450302+0000","last_undegraded":"2024-04-13T02:45:27.450302+0000","last_fullsized":"2024-04-13T02:45:27.450302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464787+0000","last_change":"2024-04-13T02:45:27.457617+0000","last_active":"2024-04-13T02:45:27.464787+0000","last_peered":"2024-04-13T02:45:27.464787+0000","last_clean":"2024-04-13T02:45:27.464787+0000","last_became_active":"2024-04-13T02:45:27.457319+0000","last_became_peered":"2024-04-13T02:45:27.457319+0000","last_unstale":"2024-04-13T02:45:27.464787+0000","last_undegraded":"2024-04-13T02:45:27.464787+0000","last_fullsized":"2024-04-13T02:45:27.464787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446037+0000","last_change":"2024-04-13T02:45:27.446037+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446037+0000","last_undegraded":"2024-04-13T02:45:27.446037+0000","last_fullsized":"2024-04-13T02:45:27.446037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465195+0000","last_change":"2024-04-13T02:45:27.463132+0000","last_active":"2024-04-13T02:45:27.465195+0000","last_peered":"2024-04-13T02:45:27.465195+0000","last_clean":"2024-04-13T02:45:27.465195+0000","last_became_active":"2024-04-13T02:45:27.462833+0000","last_became_peered":"2024-04-13T02:45:27.462833+0000","last_unstale":"2024-04-13T02:45:27.465195+0000","last_undegraded":"2024-04-13T02:45:27.465195+0000","last_fullsized":"2024-04-13T02:45:27.465195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:10:33.583403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452371+0000","last_change":"2024-04-13T02:45:27.452371+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452371+0000","last_undegraded":"2024-04-13T02:45:27.452371+0000","last_fullsized":"2024-04-13T02:45:27.452371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462081+0000","last_change":"2024-04-13T02:45:27.456759+0000","last_active":"2024-04-13T02:45:27.462081+0000","last_peered":"2024-04-13T02:45:27.462081+0000","last_clean":"2024-04-13T02:45:27.462081+0000","last_became_active":"2024-04-13T02:45:27.456503+0000","last_became_peered":"2024-04-13T02:45:27.456503+0000","last_unstale":"2024-04-13T02:45:27.462081+0000","last_undegraded":"2024-04-13T02:45:27.462081+0000","last_fullsized":"2024-04-13T02:45:27.462081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:01:31.847609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450027+0000","last_change":"2024-04-13T02:45:27.450027+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450027+0000","last_undegraded":"2024-04-13T02:45:27.450027+0000","last_fullsized":"2024-04-13T02:45:27.450027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462361+0000","last_change":"2024-04-13T02:45:27.458838+0000","last_active":"2024-04-13T02:45:27.462361+0000","last_peered":"2024-04-13T02:45:27.462361+0000","last_clean":"2024-04-13T02:45:27.462361+0000","last_became_active":"2024-04-13T02:45:27.458520+0000","last_became_peered":"2024-04-13T02:45:27.458520+0000","last_unstale":"2024-04-13T02:45:27.462361+0000","last_undegraded":"2024-04-13T02:45:27.462361+0000","last_fullsized":"2024-04-13T02:45:27.462361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449541+0000","last_change":"2024-04-13T02:45:27.449541+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449541+0000","last_undegraded":"2024-04-13T02:45:27.449541+0000","last_fullsized":"2024-04-13T02:45:27.449541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464181+0000","last_change":"2024-04-13T02:45:27.463079+0000","last_active":"2024-04-13T02:45:27.464181+0000","last_peered":"2024-04-13T02:45:27.464181+0000","last_clean":"2024-04-13T02:45:27.464181+0000","last_became_active":"2024-04-13T02:45:27.461886+0000","last_became_peered":"2024-04-13T02:45:27.461886+0000","last_unstale":"2024-04-13T02:45:27.464181+0000","last_undegraded":"2024-04-13T02:45:27.464181+0000","last_fullsized":"2024-04-13T02:45:27.464181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455683+0000","last_change":"2024-04-13T02:45:27.455683+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455683+0000","last_undegraded":"2024-04-13T02:45:27.455683+0000","last_fullsized":"2024-04-13T02:45:27.455683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464924+0000","last_change":"2024-04-13T02:45:27.460661+0000","last_active":"2024-04-13T02:45:27.464924+0000","last_peered":"2024-04-13T02:45:27.464924+0000","last_clean":"2024-04-13T02:45:27.464924+0000","last_became_active":"2024-04-13T02:45:27.460173+0000","last_became_peered":"2024-04-13T02:45:27.460173+0000","last_unstale":"2024-04-13T02:45:27.464924+0000","last_undegraded":"2024-04-13T02:45:27.464924+0000","last_fullsized":"2024-04-13T02:45:27.464924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:52.554776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446026+0000","last_change":"2024-04-13T02:45:27.446026+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446026+0000","last_undegraded":"2024-04-13T02:45:27.446026+0000","last_fullsized":"2024-04-13T02:45:27.446026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465212+0000","last_change":"2024-04-13T02:45:27.463704+0000","last_active":"2024-04-13T02:45:27.465212+0000","last_peered":"2024-04-13T02:45:27.465212+0000","last_clean":"2024-04-13T02:45:27.465212+0000","last_became_active":"2024-04-13T02:45:27.463451+0000","last_became_peered":"2024-04-13T02:45:27.463451+0000","last_unstale":"2024-04-13T02:45:27.465212+0000","last_undegraded":"2024-04-13T02:45:27.465212+0000","last_fullsized":"2024-04-13T02:45:27.465212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:31:03.954328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449471+0000","last_change":"2024-04-13T02:45:27.449471+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449471+0000","last_undegraded":"2024-04-13T02:45:27.449471+0000","last_fullsized":"2024-04-13T02:45:27.449471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.459655+0000","last_change":"2024-04-13T02:45:27.455259+0000","last_active":"2024-04-13T02:45:27.459655+0000","last_peered":"2024-04-13T02:45:27.459655+0000","last_clean":"2024-04-13T02:45:27.459655+0000","last_became_active":"2024-04-13T02:45:27.454963+0000","last_became_peered":"2024-04-13T02:45:27.454963+0000","last_unstale":"2024-04-13T02:45:27.459655+0000","last_undegraded":"2024-04-13T02:45:27.459655+0000","last_fullsized":"2024-04-13T02:45:27.459655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449030+0000","last_change":"2024-04-13T02:45:27.449030+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449030+0000","last_undegraded":"2024-04-13T02:45:27.449030+0000","last_fullsized":"2024-04-13T02:45:27.449030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462043+0000","last_change":"2024-04-13T02:45:27.456096+0000","last_active":"2024-04-13T02:45:27.462043+0000","last_peered":"2024-04-13T02:45:27.462043+0000","last_clean":"2024-04-13T02:45:27.462043+0000","last_became_active":"2024-04-13T02:45:27.455814+0000","last_became_peered":"2024-04-13T02:45:27.455814+0000","last_unstale":"2024-04-13T02:45:27.462043+0000","last_undegraded":"2024-04-13T02:45:27.462043+0000","last_fullsized":"2024-04-13T02:45:27.462043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:04:37.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447254+0000","last_change":"2024-04-13T02:45:27.447254+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447254+0000","last_undegraded":"2024-04-13T02:45:27.447254+0000","last_fullsized":"2024-04-13T02:45:27.447254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464950+0000","last_change":"2024-04-13T02:45:27.461165+0000","last_active":"2024-04-13T02:45:27.464950+0000","last_peered":"2024-04-13T02:45:27.464950+0000","last_clean":"2024-04-13T02:45:27.464950+0000","last_became_active":"2024-04-13T02:45:27.460919+0000","last_became_peered":"2024-04-13T02:45:27.460919+0000","last_unstale":"2024-04-13T02:45:27.464950+0000","last_undegraded":"2024-04-13T02:45:27.464950+0000","last_fullsized":"2024-04-13T02:45:27.464950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:42.420394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449963+0000","last_change":"2024-04-13T02:45:27.449963+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449963+0000","last_undegraded":"2024-04-13T02:45:27.449963+0000","last_fullsized":"2024-04-13T02:45:27.449963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462227+0000","last_change":"2024-04-13T02:45:27.456385+0000","last_active":"2024-04-13T02:45:27.462227+0000","last_peered":"2024-04-13T02:45:27.462227+0000","last_clean":"2024-04-13T02:45:27.462227+0000","last_became_active":"2024-04-13T02:45:27.456119+0000","last_became_peered":"2024-04-13T02:45:27.456119+0000","last_unstale":"2024-04-13T02:45:27.462227+0000","last_undegraded":"2024-04-13T02:45:27.462227+0000","last_fullsized":"2024-04-13T02:45:27.462227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456905+0000","last_change":"2024-04-13T02:45:27.456905+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456905+0000","last_undegraded":"2024-04-13T02:45:27.456905+0000","last_fullsized":"2024-04-13T02:45:27.456905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464275+0000","last_change":"2024-04-13T02:45:27.462257+0000","last_active":"2024-04-13T02:45:27.464275+0000","last_peered":"2024-04-13T02:45:27.464275+0000","last_clean":"2024-04-13T02:45:27.464275+0000","last_became_active":"2024-04-13T02:45:27.461973+0000","last_became_peered":"2024-04-13T02:45:27.461973+0000","last_unstale":"2024-04-13T02:45:27.464275+0000","last_undegraded":"2024-04-13T02:45:27.464275+0000","last_fullsized":"2024-04-13T02:45:27.464275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:53:32.487804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446021+0000","last_change":"2024-04-13T02:45:27.446021+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446021+0000","last_undegraded":"2024-04-13T02:45:27.446021+0000","last_fullsized":"2024-04-13T02:45:27.446021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465172+0000","last_change":"2024-04-13T02:45:27.463019+0000","last_active":"2024-04-13T02:45:27.465172+0000","last_peered":"2024-04-13T02:45:27.465172+0000","last_clean":"2024-04-13T02:45:27.465172+0000","last_became_active":"2024-04-13T02:45:27.462366+0000","last_became_peered":"2024-04-13T02:45:27.462366+0000","last_unstale":"2024-04-13T02:45:27.465172+0000","last_undegraded":"2024-04-13T02:45:27.465172+0000","last_fullsized":"2024-04-13T02:45:27.465172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:39:25.055157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451008+0000","last_change":"2024-04-13T02:45:27.451008+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451008+0000","last_undegraded":"2024-04-13T02:45:27.451008+0000","last_fullsized":"2024-04-13T02:45:27.451008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465174+0000","last_change":"2024-04-13T02:45:27.463016+0000","last_active":"2024-04-13T02:45:27.465174+0000","last_peered":"2024-04-13T02:45:27.465174+0000","last_clean":"2024-04-13T02:45:27.465174+0000","last_became_active":"2024-04-13T02:45:27.462717+0000","last_became_peered":"2024-04-13T02:45:27.462717+0000","last_unstale":"2024-04-13T02:45:27.465174+0000","last_undegraded":"2024-04-13T02:45:27.465174+0000","last_fullsized":"2024-04-13T02:45:27.465174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:18:15.566653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447467+0000","last_change":"2024-04-13T02:45:27.447467+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447467+0000","last_undegraded":"2024-04-13T02:45:27.447467+0000","last_fullsized":"2024-04-13T02:45:27.447467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.458459+0000","last_change":"2024-04-13T02:45:27.457724+0000","last_active":"2024-04-13T02:45:27.458459+0000","last_peered":"2024-04-13T02:45:27.458459+0000","last_clean":"2024-04-13T02:45:27.458459+0000","last_became_active":"2024-04-13T02:45:27.457432+0000","last_became_peered":"2024-04-13T02:45:27.457432+0000","last_unstale":"2024-04-13T02:45:27.458459+0000","last_undegraded":"2024-04-13T02:45:27.458459+0000","last_fullsized":"2024-04-13T02:45:27.458459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448118+0000","last_change":"2024-04-13T02:45:27.448118+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448118+0000","last_undegraded":"2024-04-13T02:45:27.448118+0000","last_fullsized":"2024-04-13T02:45:27.448118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462616+0000","last_change":"2024-04-13T02:45:27.460601+0000","last_active":"2024-04-13T02:45:27.462616+0000","last_peered":"2024-04-13T02:45:27.462616+0000","last_clean":"2024-04-13T02:45:27.462616+0000","last_became_active":"2024-04-13T02:45:27.460291+0000","last_became_peered":"2024-04-13T02:45:27.460291+0000","last_unstale":"2024-04-13T02:45:27.462616+0000","last_undegraded":"2024-04-13T02:45:27.462616+0000","last_fullsized":"2024-04-13T02:45:27.462616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450965+0000","last_change":"2024-04-13T02:45:27.450965+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450965+0000","last_undegraded":"2024-04-13T02:45:27.450965+0000","last_fullsized":"2024-04-13T02:45:27.450965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460959+0000","last_change":"2024-04-13T02:45:27.460370+0000","last_active":"2024-04-13T02:45:27.460959+0000","last_peered":"2024-04-13T02:45:27.460959+0000","last_clean":"2024-04-13T02:45:27.460959+0000","last_became_active":"2024-04-13T02:45:27.460094+0000","last_became_peered":"2024-04-13T02:45:27.460094+0000","last_unstale":"2024-04-13T02:45:27.460959+0000","last_undegraded":"2024-04-13T02:45:27.460959+0000","last_fullsized":"2024-04-13T02:45:27.460959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:53.178316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449120+0000","last_change":"2024-04-13T02:45:27.449120+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449120+0000","last_undegraded":"2024-04-13T02:45:27.449120+0000","last_fullsized":"2024-04-13T02:45:27.449120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.463557+0000","last_change":"2024-04-13T02:45:27.461869+0000","last_active":"2024-04-13T02:45:27.463557+0000","last_peered":"2024-04-13T02:45:27.463557+0000","last_clean":"2024-04-13T02:45:27.463557+0000","last_became_active":"2024-04-13T02:45:27.461565+0000","last_became_peered":"2024-04-13T02:45:27.461565+0000","last_unstale":"2024-04-13T02:45:27.463557+0000","last_undegraded":"2024-04-13T02:45:27.463557+0000","last_fullsized":"2024-04-13T02:45:27.463557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450936+0000","last_change":"2024-04-13T02:45:27.450936+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450936+0000","last_undegraded":"2024-04-13T02:45:27.450936+0000","last_fullsized":"2024-04-13T02:45:27.450936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462542+0000","last_change":"2024-04-13T02:45:27.459353+0000","last_active":"2024-04-13T02:45:27.462542+0000","last_peered":"2024-04-13T02:45:27.462542+0000","last_clean":"2024-04-13T02:45:27.462542+0000","last_became_active":"2024-04-13T02:45:27.459099+0000","last_became_peered":"2024-04-13T02:45:27.459099+0000","last_unstale":"2024-04-13T02:45:27.462542+0000","last_undegraded":"2024-04-13T02:45:27.462542+0000","last_fullsized":"2024-04-13T02:45:27.462542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456493+0000","last_change":"2024-04-13T02:45:27.456493+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456493+0000","last_undegraded":"2024-04-13T02:45:27.456493+0000","last_fullsized":"2024-04-13T02:45:27.456493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.454193+0000","last_change":"2024-04-13T02:45:27.453586+0000","last_active":"2024-04-13T02:45:27.454193+0000","last_peered":"2024-04-13T02:45:27.454193+0000","last_clean":"2024-04-13T02:45:27.454193+0000","last_became_active":"2024-04-13T02:45:27.453276+0000","last_became_peered":"2024-04-13T02:45:27.453276+0000","last_unstale":"2024-04-13T02:45:27.454193+0000","last_undegraded":"2024-04-13T02:45:27.454193+0000","last_fullsized":"2024-04-13T02:45:27.454193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446976+0000","last_change":"2024-04-13T02:45:27.446976+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446976+0000","last_undegraded":"2024-04-13T02:45:27.446976+0000","last_fullsized":"2024-04-13T02:45:27.446976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462322+0000","last_change":"2024-04-13T02:45:27.456466+0000","last_active":"2024-04-13T02:45:27.462322+0000","last_peered":"2024-04-13T02:45:27.462322+0000","last_clean":"2024-04-13T02:45:27.462322+0000","last_became_active":"2024-04-13T02:45:27.456102+0000","last_became_peered":"2024-04-13T02:45:27.456102+0000","last_unstale":"2024-04-13T02:45:27.462322+0000","last_undegraded":"2024-04-13T02:45:27.462322+0000","last_fullsized":"2024-04-13T02:45:27.462322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447740+0000","last_change":"2024-04-13T02:45:27.447740+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447740+0000","last_undegraded":"2024-04-13T02:45:27.447740+0000","last_fullsized":"2024-04-13T02:45:27.447740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462244+0000","last_change":"2024-04-13T02:45:27.458418+0000","last_active":"2024-04-13T02:45:27.462244+0000","last_peered":"2024-04-13T02:45:27.462244+0000","last_clean":"2024-04-13T02:45:27.462244+0000","last_became_active":"2024-04-13T02:45:27.458118+0000","last_became_peered":"2024-04-13T02:45:27.458118+0000","last_unstale":"2024-04-13T02:45:27.462244+0000","last_undegraded":"2024-04-13T02:45:27.462244+0000","last_fullsized":"2024-04-13T02:45:27.462244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447941+0000","last_change":"2024-04-13T02:45:27.447941+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447941+0000","last_undegraded":"2024-04-13T02:45:27.447941+0000","last_fullsized":"2024-04-13T02:45:27.447941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462292+0000","last_change":"2024-04-13T02:45:27.458631+0000","last_active":"2024-04-13T02:45:27.462292+0000","last_peered":"2024-04-13T02:45:27.462292+0000","last_clean":"2024-04-13T02:45:27.462292+0000","last_became_active":"2024-04-13T02:45:27.458346+0000","last_became_peered":"2024-04-13T02:45:27.458346+0000","last_unstale":"2024-04-13T02:45:27.462292+0000","last_undegraded":"2024-04-13T02:45:27.462292+0000","last_fullsized":"2024-04-13T02:45:27.462292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449799+0000","last_change":"2024-04-13T02:45:27.449799+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449799+0000","last_undegraded":"2024-04-13T02:45:27.449799+0000","last_fullsized":"2024-04-13T02:45:27.449799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460530+0000","last_change":"2024-04-13T02:45:27.459295+0000","last_active":"2024-04-13T02:45:27.460530+0000","last_peered":"2024-04-13T02:45:27.460530+0000","last_clean":"2024-04-13T02:45:27.460530+0000","last_became_active":"2024-04-13T02:45:27.459013+0000","last_became_peered":"2024-04-13T02:45:27.459013+0000","last_unstale":"2024-04-13T02:45:27.460530+0000","last_undegraded":"2024-04-13T02:45:27.460530+0000","last_fullsized":"2024-04-13T02:45:27.460530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:57:33.753742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449958+0000","last_change":"2024-04-13T02:45:27.449958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449958+0000","last_undegraded":"2024-04-13T02:45:27.449958+0000","last_fullsized":"2024-04-13T02:45:27.449958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462088+0000","last_change":"2024-04-13T02:45:27.455763+0000","last_active":"2024-04-13T02:45:27.462088+0000","last_peered":"2024-04-13T02:45:27.462088+0000","last_clean":"2024-04-13T02:45:27.462088+0000","last_became_active":"2024-04-13T02:45:27.455501+0000","last_became_peered":"2024-04-13T02:45:27.455501+0000","last_unstale":"2024-04-13T02:45:27.462088+0000","last_undegraded":"2024-04-13T02:45:27.462088+0000","last_fullsized":"2024-04-13T02:45:27.462088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:14:18.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449262+0000","last_change":"2024-04-13T02:45:27.449262+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449262+0000","last_undegraded":"2024-04-13T02:45:27.449262+0000","last_fullsized":"2024-04-13T02:45:27.449262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462291+0000","last_change":"2024-04-13T02:45:27.457081+0000","last_active":"2024-04-13T02:45:27.462291+0000","last_peered":"2024-04-13T02:45:27.462291+0000","last_clean":"2024-04-13T02:45:27.462291+0000","last_became_active":"2024-04-13T02:45:27.456809+0000","last_became_peered":"2024-04-13T02:45:27.456809+0000","last_unstale":"2024-04-13T02:45:27.462291+0000","last_undegraded":"2024-04-13T02:45:27.462291+0000","last_fullsized":"2024-04-13T02:45:27.462291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.449801+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:45:27.449801+0000","last_peered":"2024-04-13T02:45:27.449801+0000","last_clean":"2024-04-13T02:45:27.449801+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:45:27.449801+0000","last_undegraded":"2024-04-13T02:45:27.449801+0000","last_fullsized":"2024-04-13T02:45:27.449801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:45:32.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-13T02:45:32.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447920+0000', 'last_change': '2024-04-13T02:45:27.447920+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447920+0000', 'last_undegraded': '2024-04-13T02:45:27.447920+0000', 'last_fullsized': '2024-04-13T02:45:27.447920+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-13T02:45:32.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-13T02:45:32.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447887+0000', 'last_change': '2024-04-13T02:45:27.447887+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447887+0000', 'last_undegraded': '2024-04-13T02:45:27.447887+0000', 'last_fullsized': '2024-04-13T02:45:27.447887+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-13T02:45:32.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.455265+0000', 'last_change': '2024-04-13T02:45:27.455265+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.455265+0000', 'last_undegraded': '2024-04-13T02:45:27.455265+0000', 'last_fullsized': '2024-04-13T02:45:27.455265+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.448666+0000', 'last_change': '2024-04-13T02:45:27.448666+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.448666+0000', 'last_undegraded': '2024-04-13T02:45:27.448666+0000', 'last_fullsized': '2024-04-13T02:45:27.448666+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449012+0000', 'last_change': '2024-04-13T02:45:27.449012+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449012+0000', 'last_undegraded': '2024-04-13T02:45:27.449012+0000', 'last_fullsized': '2024-04-13T02:45:27.449012+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447447+0000', 'last_change': '2024-04-13T02:45:27.447447+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447447+0000', 'last_undegraded': '2024-04-13T02:45:27.447447+0000', 'last_fullsized': '2024-04-13T02:45:27.447447+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.454677+0000', 'last_change': '2024-04-13T02:45:27.454677+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.454677+0000', 'last_undegraded': '2024-04-13T02:45:27.454677+0000', 'last_fullsized': '2024-04-13T02:45:27.454677+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.454146+0000', 'last_change': '2024-04-13T02:45:27.454146+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.454146+0000', 'last_undegraded': '2024-04-13T02:45:27.454146+0000', 'last_fullsized': '2024-04-13T02:45:27.454146+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-13T02:45:32.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449888+0000', 'last_change': '2024-04-13T02:45:27.449888+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449888+0000', 'last_undegraded': '2024-04-13T02:45:27.449888+0000', 'last_fullsized': '2024-04-13T02:45:27.449888+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.448126+0000', 'last_change': '2024-04-13T02:45:27.448126+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.448126+0000', 'last_undegraded': '2024-04-13T02:45:27.448126+0000', 'last_fullsized': '2024-04-13T02:45:27.448126+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.453139+0000', 'last_change': '2024-04-13T02:45:27.453139+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.453139+0000', 'last_undegraded': '2024-04-13T02:45:27.453139+0000', 'last_fullsized': '2024-04-13T02:45:27.453139+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.454708+0000', 'last_change': '2024-04-13T02:45:27.454708+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.454708+0000', 'last_undegraded': '2024-04-13T02:45:27.454708+0000', 'last_fullsized': '2024-04-13T02:45:27.454708+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.448573+0000', 'last_change': '2024-04-13T02:45:27.448573+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.448573+0000', 'last_undegraded': '2024-04-13T02:45:27.448573+0000', 'last_fullsized': '2024-04-13T02:45:27.448573+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.446972+0000', 'last_change': '2024-04-13T02:45:27.446972+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.446972+0000', 'last_undegraded': '2024-04-13T02:45:27.446972+0000', 'last_fullsized': '2024-04-13T02:45:27.446972+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-13T02:45:32.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.454032+0000', 'last_change': '2024-04-13T02:45:27.454032+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.454032+0000', 'last_undegraded': '2024-04-13T02:45:27.454032+0000', 'last_fullsized': '2024-04-13T02:45:27.454032+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.453363+0000', 'last_change': '2024-04-13T02:45:27.453363+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.453363+0000', 'last_undegraded': '2024-04-13T02:45:27.453363+0000', 'last_fullsized': '2024-04-13T02:45:27.453363+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.453654+0000', 'last_change': '2024-04-13T02:45:27.453654+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.453654+0000', 'last_undegraded': '2024-04-13T02:45:27.453654+0000', 'last_fullsized': '2024-04-13T02:45:27.453654+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447475+0000', 'last_change': '2024-04-13T02:45:27.447475+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447475+0000', 'last_undegraded': '2024-04-13T02:45:27.447475+0000', 'last_fullsized': '2024-04-13T02:45:27.447475+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449070+0000', 'last_change': '2024-04-13T02:45:27.449070+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449070+0000', 'last_undegraded': '2024-04-13T02:45:27.449070+0000', 'last_fullsized': '2024-04-13T02:45:27.449070+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-13T02:45:32.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.450358+0000', 'last_change': '2024-04-13T02:45:27.450358+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.450358+0000', 'last_undegraded': '2024-04-13T02:45:27.450358+0000', 'last_fullsized': '2024-04-13T02:45:27.450358+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.451958+0000', 'last_change': '2024-04-13T02:45:27.451958+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.451958+0000', 'last_undegraded': '2024-04-13T02:45:27.451958+0000', 'last_fullsized': '2024-04-13T02:45:27.451958+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.451088+0000', 'last_change': '2024-04-13T02:45:27.451088+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.451088+0000', 'last_undegraded': '2024-04-13T02:45:27.451088+0000', 'last_fullsized': '2024-04-13T02:45:27.451088+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447589+0000', 'last_change': '2024-04-13T02:45:27.447589+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447589+0000', 'last_undegraded': '2024-04-13T02:45:27.447589+0000', 'last_fullsized': '2024-04-13T02:45:27.447589+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.453531+0000', 'last_change': '2024-04-13T02:45:27.453531+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.453531+0000', 'last_undegraded': '2024-04-13T02:45:27.453531+0000', 'last_fullsized': '2024-04-13T02:45:27.453531+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-13T02:45:32.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447133+0000', 'last_change': '2024-04-13T02:45:27.447133+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447133+0000', 'last_undegraded': '2024-04-13T02:45:27.447133+0000', 'last_fullsized': '2024-04-13T02:45:27.447133+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447034+0000', 'last_change': '2024-04-13T02:45:27.447034+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447034+0000', 'last_undegraded': '2024-04-13T02:45:27.447034+0000', 'last_fullsized': '2024-04-13T02:45:27.447034+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.448895+0000', 'last_change': '2024-04-13T02:45:27.448895+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.448895+0000', 'last_undegraded': '2024-04-13T02:45:27.448895+0000', 'last_fullsized': '2024-04-13T02:45:27.448895+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.453593+0000', 'last_change': '2024-04-13T02:45:27.453593+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.453593+0000', 'last_undegraded': '2024-04-13T02:45:27.453593+0000', 'last_fullsized': '2024-04-13T02:45:27.453593+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.451549+0000', 'last_change': '2024-04-13T02:45:27.451549+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.451549+0000', 'last_undegraded': '2024-04-13T02:45:27.451549+0000', 'last_fullsized': '2024-04-13T02:45:27.451549+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-13T02:45:32.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.452422+0000', 'last_change': '2024-04-13T02:45:27.452422+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.452422+0000', 'last_undegraded': '2024-04-13T02:45:27.452422+0000', 'last_fullsized': '2024-04-13T02:45:27.452422+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447806+0000', 'last_change': '2024-04-13T02:45:27.447806+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447806+0000', 'last_undegraded': '2024-04-13T02:45:27.447806+0000', 'last_fullsized': '2024-04-13T02:45:27.447806+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.451834+0000', 'last_change': '2024-04-13T02:45:27.451834+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.451834+0000', 'last_undegraded': '2024-04-13T02:45:27.451834+0000', 'last_fullsized': '2024-04-13T02:45:27.451834+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447569+0000', 'last_change': '2024-04-13T02:45:27.447569+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447569+0000', 'last_undegraded': '2024-04-13T02:45:27.447569+0000', 'last_fullsized': '2024-04-13T02:45:27.447569+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447464+0000', 'last_change': '2024-04-13T02:45:27.447464+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447464+0000', 'last_undegraded': '2024-04-13T02:45:27.447464+0000', 'last_fullsized': '2024-04-13T02:45:27.447464+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.451381+0000', 'last_change': '2024-04-13T02:45:27.451381+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.451381+0000', 'last_undegraded': '2024-04-13T02:45:27.451381+0000', 'last_fullsized': '2024-04-13T02:45:27.451381+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.446549+0000', 'last_change': '2024-04-13T02:45:27.446549+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.446549+0000', 'last_undegraded': '2024-04-13T02:45:27.446549+0000', 'last_fullsized': '2024-04-13T02:45:27.446549+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.450455+0000', 'last_change': '2024-04-13T02:45:27.450455+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.450455+0000', 'last_undegraded': '2024-04-13T02:45:27.450455+0000', 'last_fullsized': '2024-04-13T02:45:27.450455+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.453505+0000', 'last_change': '2024-04-13T02:45:27.453505+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.453505+0000', 'last_undegraded': '2024-04-13T02:45:27.453505+0000', 'last_fullsized': '2024-04-13T02:45:27.453505+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.450302+0000', 'last_change': '2024-04-13T02:45:27.450302+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.450302+0000', 'last_undegraded': '2024-04-13T02:45:27.450302+0000', 'last_fullsized': '2024-04-13T02:45:27.450302+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.446037+0000', 'last_change': '2024-04-13T02:45:27.446037+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.446037+0000', 'last_undegraded': '2024-04-13T02:45:27.446037+0000', 'last_fullsized': '2024-04-13T02:45:27.446037+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-13T02:45:32.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.452371+0000', 'last_change': '2024-04-13T02:45:27.452371+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.452371+0000', 'last_undegraded': '2024-04-13T02:45:27.452371+0000', 'last_fullsized': '2024-04-13T02:45:27.452371+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.450027+0000', 'last_change': '2024-04-13T02:45:27.450027+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.450027+0000', 'last_undegraded': '2024-04-13T02:45:27.450027+0000', 'last_fullsized': '2024-04-13T02:45:27.450027+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449541+0000', 'last_change': '2024-04-13T02:45:27.449541+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449541+0000', 'last_undegraded': '2024-04-13T02:45:27.449541+0000', 'last_fullsized': '2024-04-13T02:45:27.449541+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.455683+0000', 'last_change': '2024-04-13T02:45:27.455683+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.455683+0000', 'last_undegraded': '2024-04-13T02:45:27.455683+0000', 'last_fullsized': '2024-04-13T02:45:27.455683+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.446026+0000', 'last_change': '2024-04-13T02:45:27.446026+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.446026+0000', 'last_undegraded': '2024-04-13T02:45:27.446026+0000', 'last_fullsized': '2024-04-13T02:45:27.446026+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-13T02:45:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449471+0000', 'last_change': '2024-04-13T02:45:27.449471+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449471+0000', 'last_undegraded': '2024-04-13T02:45:27.449471+0000', 'last_fullsized': '2024-04-13T02:45:27.449471+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449030+0000', 'last_change': '2024-04-13T02:45:27.449030+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449030+0000', 'last_undegraded': '2024-04-13T02:45:27.449030+0000', 'last_fullsized': '2024-04-13T02:45:27.449030+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447254+0000', 'last_change': '2024-04-13T02:45:27.447254+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447254+0000', 'last_undegraded': '2024-04-13T02:45:27.447254+0000', 'last_fullsized': '2024-04-13T02:45:27.447254+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449963+0000', 'last_change': '2024-04-13T02:45:27.449963+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449963+0000', 'last_undegraded': '2024-04-13T02:45:27.449963+0000', 'last_fullsized': '2024-04-13T02:45:27.449963+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.456905+0000', 'last_change': '2024-04-13T02:45:27.456905+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.456905+0000', 'last_undegraded': '2024-04-13T02:45:27.456905+0000', 'last_fullsized': '2024-04-13T02:45:27.456905+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-13T02:45:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.446021+0000', 'last_change': '2024-04-13T02:45:27.446021+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.446021+0000', 'last_undegraded': '2024-04-13T02:45:27.446021+0000', 'last_fullsized': '2024-04-13T02:45:27.446021+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.451008+0000', 'last_change': '2024-04-13T02:45:27.451008+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.451008+0000', 'last_undegraded': '2024-04-13T02:45:27.451008+0000', 'last_fullsized': '2024-04-13T02:45:27.451008+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447467+0000', 'last_change': '2024-04-13T02:45:27.447467+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447467+0000', 'last_undegraded': '2024-04-13T02:45:27.447467+0000', 'last_fullsized': '2024-04-13T02:45:27.447467+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.448118+0000', 'last_change': '2024-04-13T02:45:27.448118+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.448118+0000', 'last_undegraded': '2024-04-13T02:45:27.448118+0000', 'last_fullsized': '2024-04-13T02:45:27.448118+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.450965+0000', 'last_change': '2024-04-13T02:45:27.450965+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.450965+0000', 'last_undegraded': '2024-04-13T02:45:27.450965+0000', 'last_fullsized': '2024-04-13T02:45:27.450965+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449120+0000', 'last_change': '2024-04-13T02:45:27.449120+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449120+0000', 'last_undegraded': '2024-04-13T02:45:27.449120+0000', 'last_fullsized': '2024-04-13T02:45:27.449120+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-13T02:45:32.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.450936+0000', 'last_change': '2024-04-13T02:45:27.450936+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.450936+0000', 'last_undegraded': '2024-04-13T02:45:27.450936+0000', 'last_fullsized': '2024-04-13T02:45:27.450936+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.456493+0000', 'last_change': '2024-04-13T02:45:27.456493+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.456493+0000', 'last_undegraded': '2024-04-13T02:45:27.456493+0000', 'last_fullsized': '2024-04-13T02:45:27.456493+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.446976+0000', 'last_change': '2024-04-13T02:45:27.446976+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.446976+0000', 'last_undegraded': '2024-04-13T02:45:27.446976+0000', 'last_fullsized': '2024-04-13T02:45:27.446976+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447740+0000', 'last_change': '2024-04-13T02:45:27.447740+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447740+0000', 'last_undegraded': '2024-04-13T02:45:27.447740+0000', 'last_fullsized': '2024-04-13T02:45:27.447740+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.447941+0000', 'last_change': '2024-04-13T02:45:27.447941+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.447941+0000', 'last_undegraded': '2024-04-13T02:45:27.447941+0000', 'last_fullsized': '2024-04-13T02:45:27.447941+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-13T02:45:32.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449799+0000', 'last_change': '2024-04-13T02:45:27.449799+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449799+0000', 'last_undegraded': '2024-04-13T02:45:27.449799+0000', 'last_fullsized': '2024-04-13T02:45:27.449799+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-13T02:45:32.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-13T02:45:32.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449958+0000', 'last_change': '2024-04-13T02:45:27.449958+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449958+0000', 'last_undegraded': '2024-04-13T02:45:27.449958+0000', 'last_fullsized': '2024-04-13T02:45:27.449958+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-13T02:45:32.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-13T02:45:32.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-13T02:45:27.449262+0000', 'last_change': '2024-04-13T02:45:27.449262+0000', 'last_active': '2024-04-13T02:45:27.434421+0000', 'last_peered': '2024-04-13T02:45:27.434421+0000', 'last_clean': '2024-04-13T02:45:27.434421+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-13T02:45:27.449262+0000', 'last_undegraded': '2024-04-13T02:45:27.449262+0000', 'last_fullsized': '2024-04-13T02:45:27.449262+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'last_clean_scrub_stamp': '2024-04-13T02:45:27.434421+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-13T02:45:32.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-13T02:45:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.248+0000 7f3a9af5e640 1 Processor -- start 2024-04-13T02:45:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.248+0000 7f3a9af5e640 1 -- start start 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a9af5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a9406cef0 0x7f3a94073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a9af5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9406bad0 con 0x7f3a940736c0 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a9af5e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9406bdb0 con 0x7f3a9415c960 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a9af5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3a94073b30 con 0x7f3a9406cef0 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a93fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a9406cef0 0x7f3a94073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a994fb640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3a940736c0 0x7f3a940cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44930/0 (socket says 172.21.15.114:44930) 2024-04-13T02:45:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a994fb640 1 -- 172.21.15.114:0/486868114 learned_addr learned my addr 172.21.15.114:0/486868114 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.249+0000 7f3a93fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a9406cef0 0x7f3a94073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43204/0 (socket says 172.21.15.114:43204) 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a93fff640 1 -- 172.21.15.114:0/486868114 >> v1:172.21.15.130:6789/0 conn(0x7f3a9415c960 legacy=0x7f3a940b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a93fff640 1 -- 172.21.15.114:0/486868114 >> v1:172.21.15.114:6789/0 conn(0x7f3a940736c0 legacy=0x7f3a940cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a93fff640 1 -- 172.21.15.114:0/486868114 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9406c090 con 0x7f3a9406cef0 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a937fe640 1 -- 172.21.15.114:0/486868114 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766422188 0 0) 0x7f3a9406bad0 con 0x7f3a940736c0 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a93fff640 1 --2- 172.21.15.114:0/486868114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a94073180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097a0 tx=0x7f3a8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa43823ce3567d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a937fe640 1 -- 172.21.15.114:0/486868114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88035020 con 0x7f3a9406cef0 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a937fe640 1 -- 172.21.15.114:0/486868114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88031830 con 0x7f3a9406cef0 2024-04-13T02:45:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.250+0000 7f3a937fe640 1 -- 172.21.15.114:0/486868114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88031c00 con 0x7f3a9406cef0 2024-04-13T02:45:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 -- 172.21.15.114:0/486868114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 msgr2=0x7f3a94073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/486868114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a94073180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097a0 tx=0x7f3a8802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 -- 172.21.15.114:0/486868114 shutdown_connections 2024-04-13T02:45:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/486868114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a94073180 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 -- 172.21.15.114:0/486868114 >> 172.21.15.114:0/486868114 conn(0x7f3a9406f8d0 msgr2=0x7f3a94072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 -- 172.21.15.114:0/486868114 shutdown_connections 2024-04-13T02:45:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.251+0000 7f3a9af5e640 1 -- 172.21.15.114:0/486868114 wait complete. 2024-04-13T02:45:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.252+0000 7f3a9af5e640 1 Processor -- start 2024-04-13T02:45:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.252+0000 7f3a9af5e640 1 -- start start 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a9af5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a9415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a9af5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a940736c0 0x7f3a9415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a9af5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a9415c960 0x7f3a941f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a9af5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9406c6e0 con 0x7f3a9406cef0 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a9af5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a940ce3b0 con 0x7f3a9415c960 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a9af5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940ce530 con 0x7f3a940736c0 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a9415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a9415e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43220/0 (socket says 172.21.15.114:43220) 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 -- 172.21.15.114:0/2888387559 learned_addr learned my addr 172.21.15.114:0/2888387559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 -- 172.21.15.114:0/2888387559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a940736c0 msgr2=0x7f3a9415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a940736c0 0x7f3a9415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 -- 172.21.15.114:0/2888387559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a9415c960 msgr2=0x7f3a941f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a9415c960 0x7f3a941f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.253+0000 7f3a98cfa640 1 -- 172.21.15.114:0/2888387559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a941f8db0 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.254+0000 7f3a98cfa640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a9415e330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400b420 tx=0x7f3a8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.254+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011830 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.254+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84016070 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.254+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a94144ec0 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.254+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011c10 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.254+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a94145480 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.255+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a94068c80 con 0x7f3a9406cef0 2024-04-13T02:45:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.255+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a8401b460 con 0x7f3a9406cef0 2024-04-13T02:45:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.256+0000 7f3a917fa640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a8006c920 0x7f3a8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.256+0000 7f3a93fff640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a8006c920 0x7f3a8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.256+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3a8408b830 con 0x7f3a9406cef0 2024-04-13T02:45:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.256+0000 7f3a93fff640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a8006c920 0x7f3a8006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3a88036000 tx=0x7f3a88030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.260+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a84059c60 con 0x7f3a9406cef0 2024-04-13T02:45:32.414 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-04-13T02:45:32.412+0000 7f9813df1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:45:32.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.500+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3a9415f860 con 0x7f3a9406cef0 2024-04-13T02:45:32.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.501+0000 7f3a917fa640 1 -- 172.21.15.114:0/2888387559 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1582 (secure 0 0 0) 0x7f3a84059560 con 0x7f3a9406cef0 2024-04-13T02:45:32.501 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:32.502 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":77,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1712976266,"num_in_osds":8,"osd_in_since":1712976257,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225026048,"bytes_avail":772869087232,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5082}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-13T02:45:29.497040+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-13T02:45:32.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.502+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a8006c920 msgr2=0x7f3a8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.502+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a8006c920 0x7f3a8006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3a88036000 tx=0x7f3a88030000 comp rx=0 tx=0).stop 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.502+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 msgr2=0x7f3a9415e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.502+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a9415e330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400b420 tx=0x7f3a8400b8e0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 shutdown_connections 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a9415c960 0x7f3a941f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3a8006c920 0x7f3a8006ede0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a940736c0 0x7f3a9415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 --2- 172.21.15.114:0/2888387559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a9406cef0 0x7f3a9415e330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 >> 172.21.15.114:0/2888387559 conn(0x7f3a9406f8d0 msgr2=0x7f3a9415a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 shutdown_connections 2024-04-13T02:45:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.503+0000 7f3a9af5e640 1 -- 172.21.15.114:0/2888387559 wait complete. 2024-04-13T02:45:32.514 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-13T02:45:32.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:45:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.613+0000 7f0b8e71e640 1 Processor -- start 2024-04-13T02:45:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.613+0000 7f0b8e71e640 1 -- start start 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b8e71e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b880af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b8e71e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b880b1860 con 0x7f0b8815ea70 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b8e71e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b880b1b40 con 0x7f0b880b5a30 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b8e71e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b880b1e20 con 0x7f0b880b12e0 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b87fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0b8815ea70 0x7f0b880b5320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44940/0 (socket says 172.21.15.114:44940) 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b87fff640 1 -- 172.21.15.114:0/1173071020 learned_addr learned my addr 172.21.15.114:0/1173071020 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349663354 0 0) 0x7f0b880b1860 con 0x7f0b8815ea70 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b70003520 con 0x7f0b8815ea70 2024-04-13T02:45:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.614+0000 7f0b8ccbb640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b880af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1098035661 0 0) 0x7f0b70003520 con 0x7f0b8815ea70 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 msgr2=0x7f0b880af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b880af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 >> v1:172.21.15.130:6789/0 conn(0x7f0b880b5a30 legacy=0x7f0b880af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b880b2100 con 0x7f0b8815ea70 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f0b78001670 con 0x7f0b8815ea70 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 >> v1:172.21.15.114:6789/0 conn(0x7f0b8815ea70 legacy=0x7f0b880b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b70003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b70004800 0x7f0b70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0b880b1e20 con 0x7f0b700039e0 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7000ba70 con 0x7f0b70004800 2024-04-13T02:45:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7000bc70 con 0x7f0b880b12e0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b70003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b877fe640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b70004800 0x7f0b70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b8ccbb640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b87fff640 1 -- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 msgr2=0x7f0b700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b87fff640 1 -- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b70004800 msgr2=0x7f0b70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b70004800 0x7f0b70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b87fff640 1 -- 172.21.15.114:0/1173071020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b70003520 con 0x7f0b700039e0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.615+0000 7f0b8ccbb640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b880b12e0 0x7f0b700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b70003e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c210 tx=0x7f0b70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b272465c0f0c2ee server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007d10 con 0x7f0b700039e0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b78030070 con 0x7f0b700039e0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b86ffd640 1 -- 172.21.15.114:0/1173071020 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78005d30 con 0x7f0b700039e0 2024-04-13T02:45:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1173071020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 msgr2=0x7f0b70003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1173071020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b70003e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c210 tx=0x7f0b70005830 comp rx=0 tx=0).stop 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b8ccbb640 1 -- 172.21.15.114:0/1173071020 reap_dead start 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1173071020 shutdown_connections 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.616+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1173071020 >> 172.21.15.114:0/1173071020 conn(0x7f0b880b6f50 msgr2=0x7f0b8809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.617+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1173071020 shutdown_connections 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.617+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1173071020 wait complete. 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.618+0000 7f0b8e71e640 1 Processor -- start 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.618+0000 7f0b8e71e640 1 -- start start 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.618+0000 7f0b8e71e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b8814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b8814ce30 0x7f0b8815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b881612d0 0x7f0b88161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8815efd0 con 0x7f0b700039e0 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8815ee50 con 0x7f0b881612d0 2024-04-13T02:45:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8809b2a0 con 0x7f0b8814ce30 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b8814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b8814fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43248/0 (socket says 172.21.15.114:43248) 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 -- 172.21.15.114:0/1084123265 learned_addr learned my addr 172.21.15.114:0/1084123265 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8ccbb640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b881612d0 0x7f0b88161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b877fe640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b8814ce30 0x7f0b8815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 -- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b8814ce30 msgr2=0x7f0b8815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b8814ce30 0x7f0b8815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 -- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b881612d0 msgr2=0x7f0b88161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b881612d0 0x7f0b88161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 -- 172.21.15.114:0/1084123265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8814d2b0 con 0x7f0b700039e0 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b877fe640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b8814ce30 0x7f0b8815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b87fff640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b8814fe00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0b78000f60 tx=0x7f0b880b1a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007d10 con 0x7f0b700039e0 2024-04-13T02:45:32.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b78004bf0 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8815fa30 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007070 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.619+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8815fff0 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.620+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b88068c80 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.621+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b78007210 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.621+0000 7f0b84ff9640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0b7406c920 0x7f0b7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.621+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0b780ad170 con 0x7f0b700039e0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.621+0000 7f0b877fe640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0b7406c920 0x7f0b7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.622+0000 7f0b877fe640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0b7406c920 0x7f0b7406ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0b880b65a0 tx=0x7f0b7c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.626+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b7807b5a0 con 0x7f0b700039e0 2024-04-13T02:45:32.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.797+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b88071b00 con 0x7f0b7406c920 2024-04-13T02:45:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.802+0000 7f0b84ff9640 1 -- 172.21.15.114:0/1084123265 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f0b88071b00 con 0x7f0b7406c920 2024-04-13T02:45:32.805 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:32.807 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0b7406c920 msgr2=0x7f0b7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0b7406c920 0x7f0b7406ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0b880b65a0 tx=0x7f0b7c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 msgr2=0x7f0b8814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b8814fe00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0b78000f60 tx=0x7f0b880b1a30 comp rx=0 tx=0).stop 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 shutdown_connections 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b881612d0 0x7f0b88161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0b7406c920 0x7f0b7406ede0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b8814ce30 0x7f0b8815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 --2- 172.21.15.114:0/1084123265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b700039e0 0x7f0b8814fe00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.805+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 >> 172.21.15.114:0/1084123265 conn(0x7f0b880b6f50 msgr2=0x7f0b8806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.806+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 shutdown_connections 2024-04-13T02:45:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:32.806+0000 7f0b8e71e640 1 -- 172.21.15.114:0/1084123265 wait complete. 2024-04-13T02:45:32.817 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-13T02:45:31.497321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.062977"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447920+0000","last_change":"2024-04-13T02:45:27.447920+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447920+0000","last_undegraded":"2024-04-13T02:45:27.447920+0000","last_fullsized":"2024-04-13T02:45:27.447920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447887+0000","last_change":"2024-04-13T02:45:27.447887+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447887+0000","last_undegraded":"2024-04-13T02:45:27.447887+0000","last_fullsized":"2024-04-13T02:45:27.447887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455265+0000","last_change":"2024-04-13T02:45:27.455265+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455265+0000","last_undegraded":"2024-04-13T02:45:27.455265+0000","last_fullsized":"2024-04-13T02:45:27.455265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448666+0000","last_change":"2024-04-13T02:45:27.448666+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448666+0000","last_undegraded":"2024-04-13T02:45:27.448666+0000","last_fullsized":"2024-04-13T02:45:27.448666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449012+0000","last_change":"2024-04-13T02:45:27.449012+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449012+0000","last_undegraded":"2024-04-13T02:45:27.449012+0000","last_fullsized":"2024-04-13T02:45:27.449012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447447+0000","last_change":"2024-04-13T02:45:27.447447+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447447+0000","last_undegraded":"2024-04-13T02:45:27.447447+0000","last_fullsized":"2024-04-13T02:45:27.447447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454677+0000","last_change":"2024-04-13T02:45:27.454677+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454677+0000","last_undegraded":"2024-04-13T02:45:27.454677+0000","last_fullsized":"2024-04-13T02:45:27.454677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454146+0000","last_change":"2024-04-13T02:45:27.454146+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454146+0000","last_undegraded":"2024-04-13T02:45:27.454146+0000","last_fullsized":"2024-04-13T02:45:27.454146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449888+0000","last_change":"2024-04-13T02:45:27.449888+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449888+0000","last_undegraded":"2024-04-13T02:45:27.449888+0000","last_fullsized":"2024-04-13T02:45:27.449888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448126+0000","last_change":"2024-04-13T02:45:27.448126+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448126+0000","last_undegraded":"2024-04-13T02:45:27.448126+0000","last_fullsized":"2024-04-13T02:45:27.448126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453139+0000","last_change":"2024-04-13T02:45:27.453139+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453139+0000","last_undegraded":"2024-04-13T02:45:27.453139+0000","last_fullsized":"2024-04-13T02:45:27.453139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454708+0000","last_change":"2024-04-13T02:45:27.454708+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454708+0000","last_undegraded":"2024-04-13T02:45:27.454708+0000","last_fullsized":"2024-04-13T02:45:27.454708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448573+0000","last_change":"2024-04-13T02:45:27.448573+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448573+0000","last_undegraded":"2024-04-13T02:45:27.448573+0000","last_fullsized":"2024-04-13T02:45:27.448573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446972+0000","last_change":"2024-04-13T02:45:27.446972+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446972+0000","last_undegraded":"2024-04-13T02:45:27.446972+0000","last_fullsized":"2024-04-13T02:45:27.446972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.454032+0000","last_change":"2024-04-13T02:45:27.454032+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.454032+0000","last_undegraded":"2024-04-13T02:45:27.454032+0000","last_fullsized":"2024-04-13T02:45:27.454032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453363+0000","last_change":"2024-04-13T02:45:27.453363+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453363+0000","last_undegraded":"2024-04-13T02:45:27.453363+0000","last_fullsized":"2024-04-13T02:45:27.453363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453654+0000","last_change":"2024-04-13T02:45:27.453654+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453654+0000","last_undegraded":"2024-04-13T02:45:27.453654+0000","last_fullsized":"2024-04-13T02:45:27.453654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447475+0000","last_change":"2024-04-13T02:45:27.447475+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447475+0000","last_undegraded":"2024-04-13T02:45:27.447475+0000","last_fullsized":"2024-04-13T02:45:27.447475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449070+0000","last_change":"2024-04-13T02:45:27.449070+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449070+0000","last_undegraded":"2024-04-13T02:45:27.449070+0000","last_fullsized":"2024-04-13T02:45:27.449070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450358+0000","last_change":"2024-04-13T02:45:27.450358+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450358+0000","last_undegraded":"2024-04-13T02:45:27.450358+0000","last_fullsized":"2024-04-13T02:45:27.450358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451958+0000","last_change":"2024-04-13T02:45:27.451958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451958+0000","last_undegraded":"2024-04-13T02:45:27.451958+0000","last_fullsized":"2024-04-13T02:45:27.451958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451088+0000","last_change":"2024-04-13T02:45:27.451088+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451088+0000","last_undegraded":"2024-04-13T02:45:27.451088+0000","last_fullsized":"2024-04-13T02:45:27.451088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447589+0000","last_change":"2024-04-13T02:45:27.447589+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447589+0000","last_undegraded":"2024-04-13T02:45:27.447589+0000","last_fullsized":"2024-04-13T02:45:27.447589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453531+0000","last_change":"2024-04-13T02:45:27.453531+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453531+0000","last_undegraded":"2024-04-13T02:45:27.453531+0000","last_fullsized":"2024-04-13T02:45:27.453531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447133+0000","last_change":"2024-04-13T02:45:27.447133+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447133+0000","last_undegraded":"2024-04-13T02:45:27.447133+0000","last_fullsized":"2024-04-13T02:45:27.447133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447034+0000","last_change":"2024-04-13T02:45:27.447034+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447034+0000","last_undegraded":"2024-04-13T02:45:27.447034+0000","last_fullsized":"2024-04-13T02:45:27.447034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448895+0000","last_change":"2024-04-13T02:45:27.448895+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448895+0000","last_undegraded":"2024-04-13T02:45:27.448895+0000","last_fullsized":"2024-04-13T02:45:27.448895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453593+0000","last_change":"2024-04-13T02:45:27.453593+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453593+0000","last_undegraded":"2024-04-13T02:45:27.453593+0000","last_fullsized":"2024-04-13T02:45:27.453593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451549+0000","last_change":"2024-04-13T02:45:27.451549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451549+0000","last_undegraded":"2024-04-13T02:45:27.451549+0000","last_fullsized":"2024-04-13T02:45:27.451549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452422+0000","last_change":"2024-04-13T02:45:27.452422+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452422+0000","last_undegraded":"2024-04-13T02:45:27.452422+0000","last_fullsized":"2024-04-13T02:45:27.452422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447806+0000","last_change":"2024-04-13T02:45:27.447806+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447806+0000","last_undegraded":"2024-04-13T02:45:27.447806+0000","last_fullsized":"2024-04-13T02:45:27.447806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451834+0000","last_change":"2024-04-13T02:45:27.451834+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451834+0000","last_undegraded":"2024-04-13T02:45:27.451834+0000","last_fullsized":"2024-04-13T02:45:27.451834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447569+0000","last_change":"2024-04-13T02:45:27.447569+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447569+0000","last_undegraded":"2024-04-13T02:45:27.447569+0000","last_fullsized":"2024-04-13T02:45:27.447569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462331+0000","last_change":"2024-04-13T02:45:27.459686+0000","last_active":"2024-04-13T02:45:27.462331+0000","last_peered":"2024-04-13T02:45:27.462331+0000","last_clean":"2024-04-13T02:45:27.462331+0000","last_became_active":"2024-04-13T02:45:27.459384+0000","last_became_peered":"2024-04-13T02:45:27.459384+0000","last_unstale":"2024-04-13T02:45:27.462331+0000","last_undegraded":"2024-04-13T02:45:27.462331+0000","last_fullsized":"2024-04-13T02:45:27.462331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447464+0000","last_change":"2024-04-13T02:45:27.447464+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447464+0000","last_undegraded":"2024-04-13T02:45:27.447464+0000","last_fullsized":"2024-04-13T02:45:27.447464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.457081+0000","last_change":"2024-04-13T02:45:27.456362+0000","last_active":"2024-04-13T02:45:27.457081+0000","last_peered":"2024-04-13T02:45:27.457081+0000","last_clean":"2024-04-13T02:45:27.457081+0000","last_became_active":"2024-04-13T02:45:27.456078+0000","last_became_peered":"2024-04-13T02:45:27.456078+0000","last_unstale":"2024-04-13T02:45:27.457081+0000","last_undegraded":"2024-04-13T02:45:27.457081+0000","last_fullsized":"2024-04-13T02:45:27.457081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451381+0000","last_change":"2024-04-13T02:45:27.451381+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451381+0000","last_undegraded":"2024-04-13T02:45:27.451381+0000","last_fullsized":"2024-04-13T02:45:27.451381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464937+0000","last_change":"2024-04-13T02:45:27.460638+0000","last_active":"2024-04-13T02:45:27.464937+0000","last_peered":"2024-04-13T02:45:27.464937+0000","last_clean":"2024-04-13T02:45:27.464937+0000","last_became_active":"2024-04-13T02:45:27.460344+0000","last_became_peered":"2024-04-13T02:45:27.460344+0000","last_unstale":"2024-04-13T02:45:27.464937+0000","last_undegraded":"2024-04-13T02:45:27.464937+0000","last_fullsized":"2024-04-13T02:45:27.464937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446549+0000","last_change":"2024-04-13T02:45:27.446549+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446549+0000","last_undegraded":"2024-04-13T02:45:27.446549+0000","last_fullsized":"2024-04-13T02:45:27.446549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462289+0000","last_change":"2024-04-13T02:45:27.460024+0000","last_active":"2024-04-13T02:45:27.462289+0000","last_peered":"2024-04-13T02:45:27.462289+0000","last_clean":"2024-04-13T02:45:27.462289+0000","last_became_active":"2024-04-13T02:45:27.459710+0000","last_became_peered":"2024-04-13T02:45:27.459710+0000","last_unstale":"2024-04-13T02:45:27.462289+0000","last_undegraded":"2024-04-13T02:45:27.462289+0000","last_fullsized":"2024-04-13T02:45:27.462289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:23:16.359328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450455+0000","last_change":"2024-04-13T02:45:27.450455+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450455+0000","last_undegraded":"2024-04-13T02:45:27.450455+0000","last_fullsized":"2024-04-13T02:45:27.450455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460486+0000","last_change":"2024-04-13T02:45:27.458957+0000","last_active":"2024-04-13T02:45:27.460486+0000","last_peered":"2024-04-13T02:45:27.460486+0000","last_clean":"2024-04-13T02:45:27.460486+0000","last_became_active":"2024-04-13T02:45:27.458428+0000","last_became_peered":"2024-04-13T02:45:27.458428+0000","last_unstale":"2024-04-13T02:45:27.460486+0000","last_undegraded":"2024-04-13T02:45:27.460486+0000","last_fullsized":"2024-04-13T02:45:27.460486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:29:38.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.453505+0000","last_change":"2024-04-13T02:45:27.453505+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.453505+0000","last_undegraded":"2024-04-13T02:45:27.453505+0000","last_fullsized":"2024-04-13T02:45:27.453505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460516+0000","last_change":"2024-04-13T02:45:27.459153+0000","last_active":"2024-04-13T02:45:27.460516+0000","last_peered":"2024-04-13T02:45:27.460516+0000","last_clean":"2024-04-13T02:45:27.460516+0000","last_became_active":"2024-04-13T02:45:27.458853+0000","last_became_peered":"2024-04-13T02:45:27.458853+0000","last_unstale":"2024-04-13T02:45:27.460516+0000","last_undegraded":"2024-04-13T02:45:27.460516+0000","last_fullsized":"2024-04-13T02:45:27.460516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:51:22.207135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450302+0000","last_change":"2024-04-13T02:45:27.450302+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450302+0000","last_undegraded":"2024-04-13T02:45:27.450302+0000","last_fullsized":"2024-04-13T02:45:27.450302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464787+0000","last_change":"2024-04-13T02:45:27.457617+0000","last_active":"2024-04-13T02:45:27.464787+0000","last_peered":"2024-04-13T02:45:27.464787+0000","last_clean":"2024-04-13T02:45:27.464787+0000","last_became_active":"2024-04-13T02:45:27.457319+0000","last_became_peered":"2024-04-13T02:45:27.457319+0000","last_unstale":"2024-04-13T02:45:27.464787+0000","last_undegraded":"2024-04-13T02:45:27.464787+0000","last_fullsized":"2024-04-13T02:45:27.464787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446037+0000","last_change":"2024-04-13T02:45:27.446037+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446037+0000","last_undegraded":"2024-04-13T02:45:27.446037+0000","last_fullsized":"2024-04-13T02:45:27.446037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465195+0000","last_change":"2024-04-13T02:45:27.463132+0000","last_active":"2024-04-13T02:45:27.465195+0000","last_peered":"2024-04-13T02:45:27.465195+0000","last_clean":"2024-04-13T02:45:27.465195+0000","last_became_active":"2024-04-13T02:45:27.462833+0000","last_became_peered":"2024-04-13T02:45:27.462833+0000","last_unstale":"2024-04-13T02:45:27.465195+0000","last_undegraded":"2024-04-13T02:45:27.465195+0000","last_fullsized":"2024-04-13T02:45:27.465195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:10:33.583403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.452371+0000","last_change":"2024-04-13T02:45:27.452371+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.452371+0000","last_undegraded":"2024-04-13T02:45:27.452371+0000","last_fullsized":"2024-04-13T02:45:27.452371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462081+0000","last_change":"2024-04-13T02:45:27.456759+0000","last_active":"2024-04-13T02:45:27.462081+0000","last_peered":"2024-04-13T02:45:27.462081+0000","last_clean":"2024-04-13T02:45:27.462081+0000","last_became_active":"2024-04-13T02:45:27.456503+0000","last_became_peered":"2024-04-13T02:45:27.456503+0000","last_unstale":"2024-04-13T02:45:27.462081+0000","last_undegraded":"2024-04-13T02:45:27.462081+0000","last_fullsized":"2024-04-13T02:45:27.462081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:01:31.847609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450027+0000","last_change":"2024-04-13T02:45:27.450027+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450027+0000","last_undegraded":"2024-04-13T02:45:27.450027+0000","last_fullsized":"2024-04-13T02:45:27.450027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462361+0000","last_change":"2024-04-13T02:45:27.458838+0000","last_active":"2024-04-13T02:45:27.462361+0000","last_peered":"2024-04-13T02:45:27.462361+0000","last_clean":"2024-04-13T02:45:27.462361+0000","last_became_active":"2024-04-13T02:45:27.458520+0000","last_became_peered":"2024-04-13T02:45:27.458520+0000","last_unstale":"2024-04-13T02:45:27.462361+0000","last_undegraded":"2024-04-13T02:45:27.462361+0000","last_fullsized":"2024-04-13T02:45:27.462361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449541+0000","last_change":"2024-04-13T02:45:27.449541+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449541+0000","last_undegraded":"2024-04-13T02:45:27.449541+0000","last_fullsized":"2024-04-13T02:45:27.449541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464181+0000","last_change":"2024-04-13T02:45:27.463079+0000","last_active":"2024-04-13T02:45:27.464181+0000","last_peered":"2024-04-13T02:45:27.464181+0000","last_clean":"2024-04-13T02:45:27.464181+0000","last_became_active":"2024-04-13T02:45:27.461886+0000","last_became_peered":"2024-04-13T02:45:27.461886+0000","last_unstale":"2024-04-13T02:45:27.464181+0000","last_undegraded":"2024-04-13T02:45:27.464181+0000","last_fullsized":"2024-04-13T02:45:27.464181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:31.724817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.455683+0000","last_change":"2024-04-13T02:45:27.455683+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.455683+0000","last_undegraded":"2024-04-13T02:45:27.455683+0000","last_fullsized":"2024-04-13T02:45:27.455683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464924+0000","last_change":"2024-04-13T02:45:27.460661+0000","last_active":"2024-04-13T02:45:27.464924+0000","last_peered":"2024-04-13T02:45:27.464924+0000","last_clean":"2024-04-13T02:45:27.464924+0000","last_became_active":"2024-04-13T02:45:27.460173+0000","last_became_peered":"2024-04-13T02:45:27.460173+0000","last_unstale":"2024-04-13T02:45:27.464924+0000","last_undegraded":"2024-04-13T02:45:27.464924+0000","last_fullsized":"2024-04-13T02:45:27.464924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:52.554776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446026+0000","last_change":"2024-04-13T02:45:27.446026+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446026+0000","last_undegraded":"2024-04-13T02:45:27.446026+0000","last_fullsized":"2024-04-13T02:45:27.446026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465212+0000","last_change":"2024-04-13T02:45:27.463704+0000","last_active":"2024-04-13T02:45:27.465212+0000","last_peered":"2024-04-13T02:45:27.465212+0000","last_clean":"2024-04-13T02:45:27.465212+0000","last_became_active":"2024-04-13T02:45:27.463451+0000","last_became_peered":"2024-04-13T02:45:27.463451+0000","last_unstale":"2024-04-13T02:45:27.465212+0000","last_undegraded":"2024-04-13T02:45:27.465212+0000","last_fullsized":"2024-04-13T02:45:27.465212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:31:03.954328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449471+0000","last_change":"2024-04-13T02:45:27.449471+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449471+0000","last_undegraded":"2024-04-13T02:45:27.449471+0000","last_fullsized":"2024-04-13T02:45:27.449471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.459655+0000","last_change":"2024-04-13T02:45:27.455259+0000","last_active":"2024-04-13T02:45:27.459655+0000","last_peered":"2024-04-13T02:45:27.459655+0000","last_clean":"2024-04-13T02:45:27.459655+0000","last_became_active":"2024-04-13T02:45:27.454963+0000","last_became_peered":"2024-04-13T02:45:27.454963+0000","last_unstale":"2024-04-13T02:45:27.459655+0000","last_undegraded":"2024-04-13T02:45:27.459655+0000","last_fullsized":"2024-04-13T02:45:27.459655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449030+0000","last_change":"2024-04-13T02:45:27.449030+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449030+0000","last_undegraded":"2024-04-13T02:45:27.449030+0000","last_fullsized":"2024-04-13T02:45:27.449030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462043+0000","last_change":"2024-04-13T02:45:27.456096+0000","last_active":"2024-04-13T02:45:27.462043+0000","last_peered":"2024-04-13T02:45:27.462043+0000","last_clean":"2024-04-13T02:45:27.462043+0000","last_became_active":"2024-04-13T02:45:27.455814+0000","last_became_peered":"2024-04-13T02:45:27.455814+0000","last_unstale":"2024-04-13T02:45:27.462043+0000","last_undegraded":"2024-04-13T02:45:27.462043+0000","last_fullsized":"2024-04-13T02:45:27.462043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:04:37.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447254+0000","last_change":"2024-04-13T02:45:27.447254+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447254+0000","last_undegraded":"2024-04-13T02:45:27.447254+0000","last_fullsized":"2024-04-13T02:45:27.447254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464950+0000","last_change":"2024-04-13T02:45:27.461165+0000","last_active":"2024-04-13T02:45:27.464950+0000","last_peered":"2024-04-13T02:45:27.464950+0000","last_clean":"2024-04-13T02:45:27.464950+0000","last_became_active":"2024-04-13T02:45:27.460919+0000","last_became_peered":"2024-04-13T02:45:27.460919+0000","last_unstale":"2024-04-13T02:45:27.464950+0000","last_undegraded":"2024-04-13T02:45:27.464950+0000","last_fullsized":"2024-04-13T02:45:27.464950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:42.420394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449963+0000","last_change":"2024-04-13T02:45:27.449963+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449963+0000","last_undegraded":"2024-04-13T02:45:27.449963+0000","last_fullsized":"2024-04-13T02:45:27.449963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462227+0000","last_change":"2024-04-13T02:45:27.456385+0000","last_active":"2024-04-13T02:45:27.462227+0000","last_peered":"2024-04-13T02:45:27.462227+0000","last_clean":"2024-04-13T02:45:27.462227+0000","last_became_active":"2024-04-13T02:45:27.456119+0000","last_became_peered":"2024-04-13T02:45:27.456119+0000","last_unstale":"2024-04-13T02:45:27.462227+0000","last_undegraded":"2024-04-13T02:45:27.462227+0000","last_fullsized":"2024-04-13T02:45:27.462227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456905+0000","last_change":"2024-04-13T02:45:27.456905+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456905+0000","last_undegraded":"2024-04-13T02:45:27.456905+0000","last_fullsized":"2024-04-13T02:45:27.456905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.464275+0000","last_change":"2024-04-13T02:45:27.462257+0000","last_active":"2024-04-13T02:45:27.464275+0000","last_peered":"2024-04-13T02:45:27.464275+0000","last_clean":"2024-04-13T02:45:27.464275+0000","last_became_active":"2024-04-13T02:45:27.461973+0000","last_became_peered":"2024-04-13T02:45:27.461973+0000","last_unstale":"2024-04-13T02:45:27.464275+0000","last_undegraded":"2024-04-13T02:45:27.464275+0000","last_fullsized":"2024-04-13T02:45:27.464275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:53:32.487804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446021+0000","last_change":"2024-04-13T02:45:27.446021+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446021+0000","last_undegraded":"2024-04-13T02:45:27.446021+0000","last_fullsized":"2024-04-13T02:45:27.446021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465172+0000","last_change":"2024-04-13T02:45:27.463019+0000","last_active":"2024-04-13T02:45:27.465172+0000","last_peered":"2024-04-13T02:45:27.465172+0000","last_clean":"2024-04-13T02:45:27.465172+0000","last_became_active":"2024-04-13T02:45:27.462366+0000","last_became_peered":"2024-04-13T02:45:27.462366+0000","last_unstale":"2024-04-13T02:45:27.465172+0000","last_undegraded":"2024-04-13T02:45:27.465172+0000","last_fullsized":"2024-04-13T02:45:27.465172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:39:25.055157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.451008+0000","last_change":"2024-04-13T02:45:27.451008+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.451008+0000","last_undegraded":"2024-04-13T02:45:27.451008+0000","last_fullsized":"2024-04-13T02:45:27.451008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.465174+0000","last_change":"2024-04-13T02:45:27.463016+0000","last_active":"2024-04-13T02:45:27.465174+0000","last_peered":"2024-04-13T02:45:27.465174+0000","last_clean":"2024-04-13T02:45:27.465174+0000","last_became_active":"2024-04-13T02:45:27.462717+0000","last_became_peered":"2024-04-13T02:45:27.462717+0000","last_unstale":"2024-04-13T02:45:27.465174+0000","last_undegraded":"2024-04-13T02:45:27.465174+0000","last_fullsized":"2024-04-13T02:45:27.465174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:18:15.566653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447467+0000","last_change":"2024-04-13T02:45:27.447467+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447467+0000","last_undegraded":"2024-04-13T02:45:27.447467+0000","last_fullsized":"2024-04-13T02:45:27.447467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.458459+0000","last_change":"2024-04-13T02:45:27.457724+0000","last_active":"2024-04-13T02:45:27.458459+0000","last_peered":"2024-04-13T02:45:27.458459+0000","last_clean":"2024-04-13T02:45:27.458459+0000","last_became_active":"2024-04-13T02:45:27.457432+0000","last_became_peered":"2024-04-13T02:45:27.457432+0000","last_unstale":"2024-04-13T02:45:27.458459+0000","last_undegraded":"2024-04-13T02:45:27.458459+0000","last_fullsized":"2024-04-13T02:45:27.458459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.448118+0000","last_change":"2024-04-13T02:45:27.448118+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.448118+0000","last_undegraded":"2024-04-13T02:45:27.448118+0000","last_fullsized":"2024-04-13T02:45:27.448118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462616+0000","last_change":"2024-04-13T02:45:27.460601+0000","last_active":"2024-04-13T02:45:27.462616+0000","last_peered":"2024-04-13T02:45:27.462616+0000","last_clean":"2024-04-13T02:45:27.462616+0000","last_became_active":"2024-04-13T02:45:27.460291+0000","last_became_peered":"2024-04-13T02:45:27.460291+0000","last_unstale":"2024-04-13T02:45:27.462616+0000","last_undegraded":"2024-04-13T02:45:27.462616+0000","last_fullsized":"2024-04-13T02:45:27.462616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450965+0000","last_change":"2024-04-13T02:45:27.450965+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450965+0000","last_undegraded":"2024-04-13T02:45:27.450965+0000","last_fullsized":"2024-04-13T02:45:27.450965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460959+0000","last_change":"2024-04-13T02:45:27.460370+0000","last_active":"2024-04-13T02:45:27.460959+0000","last_peered":"2024-04-13T02:45:27.460959+0000","last_clean":"2024-04-13T02:45:27.460959+0000","last_became_active":"2024-04-13T02:45:27.460094+0000","last_became_peered":"2024-04-13T02:45:27.460094+0000","last_unstale":"2024-04-13T02:45:27.460959+0000","last_undegraded":"2024-04-13T02:45:27.460959+0000","last_fullsized":"2024-04-13T02:45:27.460959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:33:53.178316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449120+0000","last_change":"2024-04-13T02:45:27.449120+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449120+0000","last_undegraded":"2024-04-13T02:45:27.449120+0000","last_fullsized":"2024-04-13T02:45:27.449120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.463557+0000","last_change":"2024-04-13T02:45:27.461869+0000","last_active":"2024-04-13T02:45:27.463557+0000","last_peered":"2024-04-13T02:45:27.463557+0000","last_clean":"2024-04-13T02:45:27.463557+0000","last_became_active":"2024-04-13T02:45:27.461565+0000","last_became_peered":"2024-04-13T02:45:27.461565+0000","last_unstale":"2024-04-13T02:45:27.463557+0000","last_undegraded":"2024-04-13T02:45:27.463557+0000","last_fullsized":"2024-04-13T02:45:27.463557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:52.483937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.450936+0000","last_change":"2024-04-13T02:45:27.450936+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.450936+0000","last_undegraded":"2024-04-13T02:45:27.450936+0000","last_fullsized":"2024-04-13T02:45:27.450936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462542+0000","last_change":"2024-04-13T02:45:27.459353+0000","last_active":"2024-04-13T02:45:27.462542+0000","last_peered":"2024-04-13T02:45:27.462542+0000","last_clean":"2024-04-13T02:45:27.462542+0000","last_became_active":"2024-04-13T02:45:27.459099+0000","last_became_peered":"2024-04-13T02:45:27.459099+0000","last_unstale":"2024-04-13T02:45:27.462542+0000","last_undegraded":"2024-04-13T02:45:27.462542+0000","last_fullsized":"2024-04-13T02:45:27.462542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.456493+0000","last_change":"2024-04-13T02:45:27.456493+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.456493+0000","last_undegraded":"2024-04-13T02:45:27.456493+0000","last_fullsized":"2024-04-13T02:45:27.456493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.454193+0000","last_change":"2024-04-13T02:45:27.453586+0000","last_active":"2024-04-13T02:45:27.454193+0000","last_peered":"2024-04-13T02:45:27.454193+0000","last_clean":"2024-04-13T02:45:27.454193+0000","last_became_active":"2024-04-13T02:45:27.453276+0000","last_became_peered":"2024-04-13T02:45:27.453276+0000","last_unstale":"2024-04-13T02:45:27.454193+0000","last_undegraded":"2024-04-13T02:45:27.454193+0000","last_fullsized":"2024-04-13T02:45:27.454193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.446976+0000","last_change":"2024-04-13T02:45:27.446976+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.446976+0000","last_undegraded":"2024-04-13T02:45:27.446976+0000","last_fullsized":"2024-04-13T02:45:27.446976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462322+0000","last_change":"2024-04-13T02:45:27.456466+0000","last_active":"2024-04-13T02:45:27.462322+0000","last_peered":"2024-04-13T02:45:27.462322+0000","last_clean":"2024-04-13T02:45:27.462322+0000","last_became_active":"2024-04-13T02:45:27.456102+0000","last_became_peered":"2024-04-13T02:45:27.456102+0000","last_unstale":"2024-04-13T02:45:27.462322+0000","last_undegraded":"2024-04-13T02:45:27.462322+0000","last_fullsized":"2024-04-13T02:45:27.462322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447740+0000","last_change":"2024-04-13T02:45:27.447740+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447740+0000","last_undegraded":"2024-04-13T02:45:27.447740+0000","last_fullsized":"2024-04-13T02:45:27.447740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462244+0000","last_change":"2024-04-13T02:45:27.458418+0000","last_active":"2024-04-13T02:45:27.462244+0000","last_peered":"2024-04-13T02:45:27.462244+0000","last_clean":"2024-04-13T02:45:27.462244+0000","last_became_active":"2024-04-13T02:45:27.458118+0000","last_became_peered":"2024-04-13T02:45:27.458118+0000","last_unstale":"2024-04-13T02:45:27.462244+0000","last_undegraded":"2024-04-13T02:45:27.462244+0000","last_fullsized":"2024-04-13T02:45:27.462244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.447941+0000","last_change":"2024-04-13T02:45:27.447941+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.447941+0000","last_undegraded":"2024-04-13T02:45:27.447941+0000","last_fullsized":"2024-04-13T02:45:27.447941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462292+0000","last_change":"2024-04-13T02:45:27.458631+0000","last_active":"2024-04-13T02:45:27.462292+0000","last_peered":"2024-04-13T02:45:27.462292+0000","last_clean":"2024-04-13T02:45:27.462292+0000","last_became_active":"2024-04-13T02:45:27.458346+0000","last_became_peered":"2024-04-13T02:45:27.458346+0000","last_unstale":"2024-04-13T02:45:27.462292+0000","last_undegraded":"2024-04-13T02:45:27.462292+0000","last_fullsized":"2024-04-13T02:45:27.462292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449799+0000","last_change":"2024-04-13T02:45:27.449799+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449799+0000","last_undegraded":"2024-04-13T02:45:27.449799+0000","last_fullsized":"2024-04-13T02:45:27.449799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.460530+0000","last_change":"2024-04-13T02:45:27.459295+0000","last_active":"2024-04-13T02:45:27.460530+0000","last_peered":"2024-04-13T02:45:27.460530+0000","last_clean":"2024-04-13T02:45:27.460530+0000","last_became_active":"2024-04-13T02:45:27.459013+0000","last_became_peered":"2024-04-13T02:45:27.459013+0000","last_unstale":"2024-04-13T02:45:27.460530+0000","last_undegraded":"2024-04-13T02:45:27.460530+0000","last_fullsized":"2024-04-13T02:45:27.460530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:57:33.753742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449958+0000","last_change":"2024-04-13T02:45:27.449958+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449958+0000","last_undegraded":"2024-04-13T02:45:27.449958+0000","last_fullsized":"2024-04-13T02:45:27.449958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462088+0000","last_change":"2024-04-13T02:45:27.455763+0000","last_active":"2024-04-13T02:45:27.462088+0000","last_peered":"2024-04-13T02:45:27.462088+0000","last_clean":"2024-04-13T02:45:27.462088+0000","last_became_active":"2024-04-13T02:45:27.455501+0000","last_became_peered":"2024-04-13T02:45:27.455501+0000","last_unstale":"2024-04-13T02:45:27.462088+0000","last_undegraded":"2024-04-13T02:45:27.462088+0000","last_fullsized":"2024-04-13T02:45:27.462088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:14:18.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-13T02:45:27.449262+0000","last_change":"2024-04-13T02:45:27.449262+0000","last_active":"2024-04-13T02:45:27.434421+0000","last_peered":"2024-04-13T02:45:27.434421+0000","last_clean":"2024-04-13T02:45:27.434421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-13T02:45:27.449262+0000","last_undegraded":"2024-04-13T02:45:27.449262+0000","last_fullsized":"2024-04-13T02:45:27.449262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.462291+0000","last_change":"2024-04-13T02:45:27.457081+0000","last_active":"2024-04-13T02:45:27.462291+0000","last_peered":"2024-04-13T02:45:27.462291+0000","last_clean":"2024-04-13T02:45:27.462291+0000","last_became_active":"2024-04-13T02:45:27.456809+0000","last_became_peered":"2024-04-13T02:45:27.456809+0000","last_unstale":"2024-04-13T02:45:27.462291+0000","last_undegraded":"2024-04-13T02:45:27.462291+0000","last_fullsized":"2024-04-13T02:45:27.462291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-13T02:45:27.449801+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:45:27.449801+0000","last_peered":"2024-04-13T02:45:27.449801+0000","last_clean":"2024-04-13T02:45:27.449801+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:45:27.449801+0000","last_undegraded":"2024-04-13T02:45:27.449801+0000","last_fullsized":"2024-04-13T02:45:27.449801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:45:34.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:45:34.012 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:45:35.826 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:45:35.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.937+0000 7f0aff9a3640 1 Processor -- start 2024-04-13T02:45:35.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.937+0000 7f0aff9a3640 1 -- start start 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0aff9a3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0af815b6d0 0x7f0af80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0aff9a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0af8070210 0x7f0af80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0aff9a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0aff9a3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0af806f940 con 0x7f0af815b6d0 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0aff9a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0af806e8a0 con 0x7f0af8070210 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0aff9a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0af806eb80 con 0x7f0af80ce250 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0af815b6d0 0x7f0af80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0af815b6d0 0x7f0af80cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43254/0 (socket says 172.21.15.114:43254) 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 -- 172.21.15.114:0/493858437 learned_addr learned my addr 172.21.15.114:0/493858437 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afdf40640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afcf3e640 1 --2- 172.21.15.114:0/493858437 >> v2:172.21.15.130:3300/0 conn(0x7f0af8070210 0x7f0af80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 -- 172.21.15.114:0/493858437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 msgr2=0x7f0af80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 -- 172.21.15.114:0/493858437 >> v2:172.21.15.130:3300/0 conn(0x7f0af8070210 msgr2=0x7f0af80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 --2- 172.21.15.114:0/493858437 >> v2:172.21.15.130:3300/0 conn(0x7f0af8070210 0x7f0af80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afd73f640 1 -- 172.21.15.114:0/493858437 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af806ee60 con 0x7f0af815b6d0 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afcf3e640 1 --2- 172.21.15.114:0/493858437 >> v2:172.21.15.130:3300/0 conn(0x7f0af8070210 0x7f0af80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.938+0000 7f0afdf40640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.939+0000 7f0afd73f640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80cdd10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0af80cf470 tx=0x7f0af402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd97af6decc4f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.939+0000 7f0aeffff640 1 -- 172.21.15.114:0/493858437 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af403b070 con 0x7f0af815b6d0 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.939+0000 7f0aeffff640 1 -- 172.21.15.114:0/493858437 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af402ee00 con 0x7f0af815b6d0 2024-04-13T02:45:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.939+0000 7f0aeffff640 1 -- 172.21.15.114:0/493858437 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4036660 con 0x7f0af815b6d0 2024-04-13T02:45:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 -- 172.21.15.114:0/493858437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 msgr2=0x7f0af80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80cdd10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0af80cf470 tx=0x7f0af402e050 comp rx=0 tx=0).stop 2024-04-13T02:45:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 -- 172.21.15.114:0/493858437 shutdown_connections 2024-04-13T02:45:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/493858437 >> v2:172.21.15.130:3300/0 conn(0x7f0af8070210 0x7f0af80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/493858437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80cdd10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 -- 172.21.15.114:0/493858437 >> 172.21.15.114:0/493858437 conn(0x7f0af80b27b0 msgr2=0x7f0af80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 -- 172.21.15.114:0/493858437 shutdown_connections 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.940+0000 7f0aff9a3640 1 -- 172.21.15.114:0/493858437 wait complete. 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.941+0000 7f0aff9a3640 1 Processor -- start 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.941+0000 7f0aff9a3640 1 -- start start 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0af8070210 0x7f0af8148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0af80721e0 con 0x7f0af815b6d0 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0af806f420 con 0x7f0af8070210 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0af8072360 con 0x7f0af80ce250 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43258/0 (socket says 172.21.15.114:43258) 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 -- 172.21.15.114:0/3479813816 learned_addr learned my addr 172.21.15.114:0/3479813816 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afd73f640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0af8070210 0x7f0af8148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afcf3e640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 -- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 msgr2=0x7f0af80b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 -- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0af8070210 msgr2=0x7f0af8148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0af8070210 0x7f0af8148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 -- 172.21.15.114:0/3479813816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af81486c0 con 0x7f0af815b6d0 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afcf3e640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0afdf40640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80af1e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0af000cef0 tx=0x7f0af000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af001a070 con 0x7f0af815b6d0 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af000d860 con 0x7f0af815b6d0 2024-04-13T02:45:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.942+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af80b3660 con 0x7f0af815b6d0 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.943+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000dc50 con 0x7f0af815b6d0 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.943+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af80b3c20 con 0x7f0af815b6d0 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.944+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af8068c80 con 0x7f0af815b6d0 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.944+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0af001d070 con 0x7f0af815b6d0 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.944+0000 7f0aedffb640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0adc06c8f0 0x7f0adc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.945+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0af008c330 con 0x7f0af815b6d0 2024-04-13T02:45:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.945+0000 7f0afd73f640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0adc06c8f0 0x7f0adc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:35.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.945+0000 7f0afd73f640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0adc06c8f0 0x7f0adc06edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0af4038000 tx=0x7f0af4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:35.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:35.949+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0af81486c0 con 0x7f0af815b6d0 2024-04-13T02:45:36.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.122+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0af80b0980 con 0x7f0adc06c8f0 2024-04-13T02:45:36.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.128+0000 7f0aedffb640 1 -- 172.21.15.114:0/3479813816 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251950 (secure 0 0 0) 0x7f0af80b0980 con 0x7f0adc06c8f0 2024-04-13T02:45:36.131 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:36.133 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:45:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0adc06c8f0 msgr2=0x7f0adc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0adc06c8f0 0x7f0adc06edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0af4038000 tx=0x7f0af4032000 comp rx=0 tx=0).stop 2024-04-13T02:45:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 msgr2=0x7f0af80af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80af1e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0af000cef0 tx=0x7f0af000a710 comp rx=0 tx=0).stop 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 shutdown_connections 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af815b6d0 0x7f0af80af1e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0adc06c8f0 0x7f0adc06edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0af80ce250 0x7f0af80b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 --2- 172.21.15.114:0/3479813816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0af8070210 0x7f0af8148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 >> 172.21.15.114:0/3479813816 conn(0x7f0af80b27b0 msgr2=0x7f0af8154260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 shutdown_connections 2024-04-13T02:45:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.131+0000 7f0aff9a3640 1 -- 172.21.15.114:0/3479813816 wait complete. 2024-04-13T02:45:36.142 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-04-13T02:45:35.498238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220144,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754576,"statfs":{"total":773094113280,"available":772868685824,"internally_reserved":0,"allocated":4038656,"data_stored":2261156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001533"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745567+0000","last_change":"2024-04-13T02:45:28.464418+0000","last_active":"2024-04-13T02:45:29.745567+0000","last_peered":"2024-04-13T02:45:29.745567+0000","last_clean":"2024-04-13T02:45:29.745567+0000","last_became_active":"2024-04-13T02:45:28.464158+0000","last_became_peered":"2024-04-13T02:45:28.464158+0000","last_unstale":"2024-04-13T02:45:29.745567+0000","last_undegraded":"2024-04-13T02:45:29.745567+0000","last_fullsized":"2024-04-13T02:45:29.745567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:57:32.732095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745403+0000","last_change":"2024-04-13T02:45:28.459483+0000","last_active":"2024-04-13T02:45:29.745403+0000","last_peered":"2024-04-13T02:45:29.745403+0000","last_clean":"2024-04-13T02:45:29.745403+0000","last_became_active":"2024-04-13T02:45:28.458881+0000","last_became_peered":"2024-04-13T02:45:28.458881+0000","last_unstale":"2024-04-13T02:45:29.745403+0000","last_undegraded":"2024-04-13T02:45:29.745403+0000","last_fullsized":"2024-04-13T02:45:29.745403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:58:36.800595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745335+0000","last_change":"2024-04-13T02:45:28.473205+0000","last_active":"2024-04-13T02:45:29.745335+0000","last_peered":"2024-04-13T02:45:29.745335+0000","last_clean":"2024-04-13T02:45:29.745335+0000","last_became_active":"2024-04-13T02:45:28.472372+0000","last_became_peered":"2024-04-13T02:45:28.472372+0000","last_unstale":"2024-04-13T02:45:29.745335+0000","last_undegraded":"2024-04-13T02:45:29.745335+0000","last_fullsized":"2024-04-13T02:45:29.745335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:12:54.424678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745948+0000","last_change":"2024-04-13T02:45:28.466316+0000","last_active":"2024-04-13T02:45:29.745948+0000","last_peered":"2024-04-13T02:45:29.745948+0000","last_clean":"2024-04-13T02:45:29.745948+0000","last_became_active":"2024-04-13T02:45:28.465164+0000","last_became_peered":"2024-04-13T02:45:28.465164+0000","last_unstale":"2024-04-13T02:45:29.745948+0000","last_undegraded":"2024-04-13T02:45:29.745948+0000","last_fullsized":"2024-04-13T02:45:29.745948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:00:46.419033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457207+0000","last_change":"2024-04-13T02:45:28.459248+0000","last_active":"2024-04-13T02:45:29.457207+0000","last_peered":"2024-04-13T02:45:29.457207+0000","last_clean":"2024-04-13T02:45:29.457207+0000","last_became_active":"2024-04-13T02:45:28.458935+0000","last_became_peered":"2024-04-13T02:45:28.458935+0000","last_unstale":"2024-04-13T02:45:29.457207+0000","last_undegraded":"2024-04-13T02:45:29.457207+0000","last_fullsized":"2024-04-13T02:45:29.457207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:43:00.585422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744824+0000","last_change":"2024-04-13T02:45:28.473743+0000","last_active":"2024-04-13T02:45:29.744824+0000","last_peered":"2024-04-13T02:45:29.744824+0000","last_clean":"2024-04-13T02:45:29.744824+0000","last_became_active":"2024-04-13T02:45:28.473499+0000","last_became_peered":"2024-04-13T02:45:28.473499+0000","last_unstale":"2024-04-13T02:45:29.744824+0000","last_undegraded":"2024-04-13T02:45:29.744824+0000","last_fullsized":"2024-04-13T02:45:29.744824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:47:46.368092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462358+0000","last_change":"2024-04-13T02:45:28.456721+0000","last_active":"2024-04-13T02:45:29.462358+0000","last_peered":"2024-04-13T02:45:29.462358+0000","last_clean":"2024-04-13T02:45:29.462358+0000","last_became_active":"2024-04-13T02:45:28.456418+0000","last_became_peered":"2024-04-13T02:45:28.456418+0000","last_unstale":"2024-04-13T02:45:29.462358+0000","last_undegraded":"2024-04-13T02:45:29.462358+0000","last_fullsized":"2024-04-13T02:45:29.462358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:39:25.759872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462218+0000","last_change":"2024-04-13T02:45:28.453572+0000","last_active":"2024-04-13T02:45:29.462218+0000","last_peered":"2024-04-13T02:45:29.462218+0000","last_clean":"2024-04-13T02:45:29.462218+0000","last_became_active":"2024-04-13T02:45:28.453245+0000","last_became_peered":"2024-04-13T02:45:28.453245+0000","last_unstale":"2024-04-13T02:45:29.462218+0000","last_undegraded":"2024-04-13T02:45:29.462218+0000","last_fullsized":"2024-04-13T02:45:29.462218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:19:41.405078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463852+0000","last_change":"2024-04-13T02:45:28.460148+0000","last_active":"2024-04-13T02:45:29.463852+0000","last_peered":"2024-04-13T02:45:29.463852+0000","last_clean":"2024-04-13T02:45:29.463852+0000","last_became_active":"2024-04-13T02:45:28.459873+0000","last_became_peered":"2024-04-13T02:45:28.459873+0000","last_unstale":"2024-04-13T02:45:29.463852+0000","last_undegraded":"2024-04-13T02:45:29.463852+0000","last_fullsized":"2024-04-13T02:45:29.463852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:47:22.644847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746104+0000","last_change":"2024-04-13T02:45:28.461782+0000","last_active":"2024-04-13T02:45:29.746104+0000","last_peered":"2024-04-13T02:45:29.746104+0000","last_clean":"2024-04-13T02:45:29.746104+0000","last_became_active":"2024-04-13T02:45:28.461531+0000","last_became_peered":"2024-04-13T02:45:28.461531+0000","last_unstale":"2024-04-13T02:45:29.746104+0000","last_undegraded":"2024-04-13T02:45:29.746104+0000","last_fullsized":"2024-04-13T02:45:29.746104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:41:21.272861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463566+0000","last_change":"2024-04-13T02:45:28.457598+0000","last_active":"2024-04-13T02:45:29.463566+0000","last_peered":"2024-04-13T02:45:29.463566+0000","last_clean":"2024-04-13T02:45:29.463566+0000","last_became_active":"2024-04-13T02:45:28.457281+0000","last_became_peered":"2024-04-13T02:45:28.457281+0000","last_unstale":"2024-04-13T02:45:29.463566+0000","last_undegraded":"2024-04-13T02:45:29.463566+0000","last_fullsized":"2024-04-13T02:45:29.463566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:57:20.677567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745116+0000","last_change":"2024-04-13T02:45:28.474926+0000","last_active":"2024-04-13T02:45:29.745116+0000","last_peered":"2024-04-13T02:45:29.745116+0000","last_clean":"2024-04-13T02:45:29.745116+0000","last_became_active":"2024-04-13T02:45:28.474625+0000","last_became_peered":"2024-04-13T02:45:28.474625+0000","last_unstale":"2024-04-13T02:45:29.745116+0000","last_undegraded":"2024-04-13T02:45:29.745116+0000","last_fullsized":"2024-04-13T02:45:29.745116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:29:01.224868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457372+0000","last_change":"2024-04-13T02:45:28.453015+0000","last_active":"2024-04-13T02:45:29.457372+0000","last_peered":"2024-04-13T02:45:29.457372+0000","last_clean":"2024-04-13T02:45:29.457372+0000","last_became_active":"2024-04-13T02:45:28.452525+0000","last_became_peered":"2024-04-13T02:45:28.452525+0000","last_unstale":"2024-04-13T02:45:29.457372+0000","last_undegraded":"2024-04-13T02:45:29.457372+0000","last_fullsized":"2024-04-13T02:45:29.457372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:12.577644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744912+0000","last_change":"2024-04-13T02:45:28.457648+0000","last_active":"2024-04-13T02:45:29.744912+0000","last_peered":"2024-04-13T02:45:29.744912+0000","last_clean":"2024-04-13T02:45:29.744912+0000","last_became_active":"2024-04-13T02:45:28.457322+0000","last_became_peered":"2024-04-13T02:45:28.457322+0000","last_unstale":"2024-04-13T02:45:29.744912+0000","last_undegraded":"2024-04-13T02:45:29.744912+0000","last_fullsized":"2024-04-13T02:45:29.744912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:06:52.449798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744979+0000","last_change":"2024-04-13T02:45:28.465502+0000","last_active":"2024-04-13T02:45:29.744979+0000","last_peered":"2024-04-13T02:45:29.744979+0000","last_clean":"2024-04-13T02:45:29.744979+0000","last_became_active":"2024-04-13T02:45:28.465200+0000","last_became_peered":"2024-04-13T02:45:28.465200+0000","last_unstale":"2024-04-13T02:45:29.744979+0000","last_undegraded":"2024-04-13T02:45:29.744979+0000","last_fullsized":"2024-04-13T02:45:29.744979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:42.294352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462645+0000","last_change":"2024-04-13T02:45:28.461901+0000","last_active":"2024-04-13T02:45:29.462645+0000","last_peered":"2024-04-13T02:45:29.462645+0000","last_clean":"2024-04-13T02:45:29.462645+0000","last_became_active":"2024-04-13T02:45:28.461537+0000","last_became_peered":"2024-04-13T02:45:28.461537+0000","last_unstale":"2024-04-13T02:45:29.462645+0000","last_undegraded":"2024-04-13T02:45:29.462645+0000","last_fullsized":"2024-04-13T02:45:29.462645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:47:46.368092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463244+0000","last_change":"2024-04-13T02:45:28.456844+0000","last_active":"2024-04-13T02:45:29.463244+0000","last_peered":"2024-04-13T02:45:29.463244+0000","last_clean":"2024-04-13T02:45:29.463244+0000","last_became_active":"2024-04-13T02:45:28.456548+0000","last_became_peered":"2024-04-13T02:45:28.456548+0000","last_unstale":"2024-04-13T02:45:29.463244+0000","last_undegraded":"2024-04-13T02:45:29.463244+0000","last_fullsized":"2024-04-13T02:45:29.463244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:24:15.709527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745435+0000","last_change":"2024-04-13T02:45:28.459693+0000","last_active":"2024-04-13T02:45:29.745435+0000","last_peered":"2024-04-13T02:45:29.745435+0000","last_clean":"2024-04-13T02:45:29.745435+0000","last_became_active":"2024-04-13T02:45:28.459221+0000","last_became_peered":"2024-04-13T02:45:28.459221+0000","last_unstale":"2024-04-13T02:45:29.745435+0000","last_undegraded":"2024-04-13T02:45:29.745435+0000","last_fullsized":"2024-04-13T02:45:29.745435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:40:21.129993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745066+0000","last_change":"2024-04-13T02:45:28.461589+0000","last_active":"2024-04-13T02:45:29.745066+0000","last_peered":"2024-04-13T02:45:29.745066+0000","last_clean":"2024-04-13T02:45:29.745066+0000","last_became_active":"2024-04-13T02:45:28.461293+0000","last_became_peered":"2024-04-13T02:45:28.461293+0000","last_unstale":"2024-04-13T02:45:29.745066+0000","last_undegraded":"2024-04-13T02:45:29.745066+0000","last_fullsized":"2024-04-13T02:45:29.745066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:24:15.709527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457288+0000","last_change":"2024-04-13T02:45:28.472834+0000","last_active":"2024-04-13T02:45:29.457288+0000","last_peered":"2024-04-13T02:45:29.457288+0000","last_clean":"2024-04-13T02:45:29.457288+0000","last_became_active":"2024-04-13T02:45:28.472555+0000","last_became_peered":"2024-04-13T02:45:28.472555+0000","last_unstale":"2024-04-13T02:45:29.457288+0000","last_undegraded":"2024-04-13T02:45:29.457288+0000","last_fullsized":"2024-04-13T02:45:29.457288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:21.541818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462960+0000","last_change":"2024-04-13T02:45:28.459069+0000","last_active":"2024-04-13T02:45:29.462960+0000","last_peered":"2024-04-13T02:45:29.462960+0000","last_clean":"2024-04-13T02:45:29.462960+0000","last_became_active":"2024-04-13T02:45:28.458800+0000","last_became_peered":"2024-04-13T02:45:28.458800+0000","last_unstale":"2024-04-13T02:45:29.462960+0000","last_undegraded":"2024-04-13T02:45:29.462960+0000","last_fullsized":"2024-04-13T02:45:29.462960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:28:07.488326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462842+0000","last_change":"2024-04-13T02:45:28.458309+0000","last_active":"2024-04-13T02:45:29.462842+0000","last_peered":"2024-04-13T02:45:29.462842+0000","last_clean":"2024-04-13T02:45:29.462842+0000","last_became_active":"2024-04-13T02:45:28.458014+0000","last_became_peered":"2024-04-13T02:45:28.458014+0000","last_unstale":"2024-04-13T02:45:29.462842+0000","last_undegraded":"2024-04-13T02:45:29.462842+0000","last_fullsized":"2024-04-13T02:45:29.462842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:57:25.386062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745678+0000","last_change":"2024-04-13T02:45:28.458131+0000","last_active":"2024-04-13T02:45:29.745678+0000","last_peered":"2024-04-13T02:45:29.745678+0000","last_clean":"2024-04-13T02:45:29.745678+0000","last_became_active":"2024-04-13T02:45:28.457853+0000","last_became_peered":"2024-04-13T02:45:28.457853+0000","last_unstale":"2024-04-13T02:45:29.745678+0000","last_undegraded":"2024-04-13T02:45:29.745678+0000","last_fullsized":"2024-04-13T02:45:29.745678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:57:25.386062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744897+0000","last_change":"2024-04-13T02:45:28.470804+0000","last_active":"2024-04-13T02:45:29.744897+0000","last_peered":"2024-04-13T02:45:29.744897+0000","last_clean":"2024-04-13T02:45:29.744897+0000","last_became_active":"2024-04-13T02:45:28.470515+0000","last_became_peered":"2024-04-13T02:45:28.470515+0000","last_unstale":"2024-04-13T02:45:29.744897+0000","last_undegraded":"2024-04-13T02:45:29.744897+0000","last_fullsized":"2024-04-13T02:45:29.744897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:26:58.800046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746268+0000","last_change":"2024-04-13T02:45:28.458892+0000","last_active":"2024-04-13T02:45:29.746268+0000","last_peered":"2024-04-13T02:45:29.746268+0000","last_clean":"2024-04-13T02:45:29.746268+0000","last_became_active":"2024-04-13T02:45:28.458609+0000","last_became_peered":"2024-04-13T02:45:28.458609+0000","last_unstale":"2024-04-13T02:45:29.746268+0000","last_undegraded":"2024-04-13T02:45:29.746268+0000","last_fullsized":"2024-04-13T02:45:29.746268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:42.294352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745509+0000","last_change":"2024-04-13T02:45:28.459828+0000","last_active":"2024-04-13T02:45:29.745509+0000","last_peered":"2024-04-13T02:45:29.745509+0000","last_clean":"2024-04-13T02:45:29.745509+0000","last_became_active":"2024-04-13T02:45:28.458567+0000","last_became_peered":"2024-04-13T02:45:28.458567+0000","last_unstale":"2024-04-13T02:45:29.745509+0000","last_undegraded":"2024-04-13T02:45:29.745509+0000","last_fullsized":"2024-04-13T02:45:29.745509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:05:46.734361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746198+0000","last_change":"2024-04-13T02:45:28.466691+0000","last_active":"2024-04-13T02:45:29.746198+0000","last_peered":"2024-04-13T02:45:29.746198+0000","last_clean":"2024-04-13T02:45:29.746198+0000","last_became_active":"2024-04-13T02:45:28.465920+0000","last_became_peered":"2024-04-13T02:45:28.465920+0000","last_unstale":"2024-04-13T02:45:29.746198+0000","last_undegraded":"2024-04-13T02:45:29.746198+0000","last_fullsized":"2024-04-13T02:45:29.746198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:33:35.558542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745148+0000","last_change":"2024-04-13T02:45:28.472500+0000","last_active":"2024-04-13T02:45:29.745148+0000","last_peered":"2024-04-13T02:45:29.745148+0000","last_clean":"2024-04-13T02:45:29.745148+0000","last_became_active":"2024-04-13T02:45:28.472196+0000","last_became_peered":"2024-04-13T02:45:28.472196+0000","last_unstale":"2024-04-13T02:45:29.745148+0000","last_undegraded":"2024-04-13T02:45:29.745148+0000","last_fullsized":"2024-04-13T02:45:29.745148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:19:41.405078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463140+0000","last_change":"2024-04-13T02:45:28.458892+0000","last_active":"2024-04-13T02:45:29.463140+0000","last_peered":"2024-04-13T02:45:29.463140+0000","last_clean":"2024-04-13T02:45:29.463140+0000","last_became_active":"2024-04-13T02:45:28.458485+0000","last_became_peered":"2024-04-13T02:45:28.458485+0000","last_unstale":"2024-04-13T02:45:29.463140+0000","last_undegraded":"2024-04-13T02:45:29.463140+0000","last_fullsized":"2024-04-13T02:45:29.463140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:22:33.297459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462306+0000","last_change":"2024-04-13T02:45:28.461906+0000","last_active":"2024-04-13T02:45:29.462306+0000","last_peered":"2024-04-13T02:45:29.462306+0000","last_clean":"2024-04-13T02:45:29.462306+0000","last_became_active":"2024-04-13T02:45:28.460355+0000","last_became_peered":"2024-04-13T02:45:28.460355+0000","last_unstale":"2024-04-13T02:45:29.462306+0000","last_undegraded":"2024-04-13T02:45:29.462306+0000","last_fullsized":"2024-04-13T02:45:29.462306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:29:01.224868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745982+0000","last_change":"2024-04-13T02:45:28.458691+0000","last_active":"2024-04-13T02:45:29.745982+0000","last_peered":"2024-04-13T02:45:29.745982+0000","last_clean":"2024-04-13T02:45:29.745982+0000","last_became_active":"2024-04-13T02:45:28.458281+0000","last_became_peered":"2024-04-13T02:45:28.458281+0000","last_unstale":"2024-04-13T02:45:29.745982+0000","last_undegraded":"2024-04-13T02:45:29.745982+0000","last_fullsized":"2024-04-13T02:45:29.745982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:43.427671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462297+0000","last_change":"2024-04-13T02:45:28.463494+0000","last_active":"2024-04-13T02:45:29.462297+0000","last_peered":"2024-04-13T02:45:29.462297+0000","last_clean":"2024-04-13T02:45:29.462297+0000","last_became_active":"2024-04-13T02:45:28.462490+0000","last_became_peered":"2024-04-13T02:45:28.462490+0000","last_unstale":"2024-04-13T02:45:29.462297+0000","last_undegraded":"2024-04-13T02:45:29.462297+0000","last_fullsized":"2024-04-13T02:45:29.462297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:24:31.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745943+0000","last_change":"2024-04-13T02:45:28.456936+0000","last_active":"2024-04-13T02:45:29.745943+0000","last_peered":"2024-04-13T02:45:29.745943+0000","last_clean":"2024-04-13T02:45:29.745943+0000","last_became_active":"2024-04-13T02:45:28.456662+0000","last_became_peered":"2024-04-13T02:45:28.456662+0000","last_unstale":"2024-04-13T02:45:29.745943+0000","last_undegraded":"2024-04-13T02:45:29.745943+0000","last_fullsized":"2024-04-13T02:45:29.745943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:35:15.318268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745688+0000","last_change":"2024-04-13T02:45:27.459686+0000","last_active":"2024-04-13T02:45:29.745688+0000","last_peered":"2024-04-13T02:45:29.745688+0000","last_clean":"2024-04-13T02:45:29.745688+0000","last_became_active":"2024-04-13T02:45:27.459384+0000","last_became_peered":"2024-04-13T02:45:27.459384+0000","last_unstale":"2024-04-13T02:45:29.745688+0000","last_undegraded":"2024-04-13T02:45:29.745688+0000","last_fullsized":"2024-04-13T02:45:29.745688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745576+0000","last_change":"2024-04-13T02:45:28.462124+0000","last_active":"2024-04-13T02:45:29.745576+0000","last_peered":"2024-04-13T02:45:29.745576+0000","last_clean":"2024-04-13T02:45:29.745576+0000","last_became_active":"2024-04-13T02:45:28.461835+0000","last_became_peered":"2024-04-13T02:45:28.461835+0000","last_unstale":"2024-04-13T02:45:29.745576+0000","last_undegraded":"2024-04-13T02:45:29.745576+0000","last_fullsized":"2024-04-13T02:45:29.745576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:53:53.491215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746042+0000","last_change":"2024-04-13T02:45:27.456362+0000","last_active":"2024-04-13T02:45:29.746042+0000","last_peered":"2024-04-13T02:45:29.746042+0000","last_clean":"2024-04-13T02:45:29.746042+0000","last_became_active":"2024-04-13T02:45:27.456078+0000","last_became_peered":"2024-04-13T02:45:27.456078+0000","last_unstale":"2024-04-13T02:45:29.746042+0000","last_undegraded":"2024-04-13T02:45:29.746042+0000","last_fullsized":"2024-04-13T02:45:29.746042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:37:05.818923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463298+0000","last_change":"2024-04-13T02:45:28.464682+0000","last_active":"2024-04-13T02:45:29.463298+0000","last_peered":"2024-04-13T02:45:29.463298+0000","last_clean":"2024-04-13T02:45:29.463298+0000","last_became_active":"2024-04-13T02:45:28.464277+0000","last_became_peered":"2024-04-13T02:45:28.464277+0000","last_unstale":"2024-04-13T02:45:29.463298+0000","last_undegraded":"2024-04-13T02:45:29.463298+0000","last_fullsized":"2024-04-13T02:45:29.463298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:12:19.667880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745153+0000","last_change":"2024-04-13T02:45:27.460638+0000","last_active":"2024-04-13T02:45:29.745153+0000","last_peered":"2024-04-13T02:45:29.745153+0000","last_clean":"2024-04-13T02:45:29.745153+0000","last_became_active":"2024-04-13T02:45:27.460344+0000","last_became_peered":"2024-04-13T02:45:27.460344+0000","last_unstale":"2024-04-13T02:45:29.745153+0000","last_undegraded":"2024-04-13T02:45:29.745153+0000","last_fullsized":"2024-04-13T02:45:29.745153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:12:18.660602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746346+0000","last_change":"2024-04-13T02:45:28.466176+0000","last_active":"2024-04-13T02:45:29.746346+0000","last_peered":"2024-04-13T02:45:29.746346+0000","last_clean":"2024-04-13T02:45:29.746346+0000","last_became_active":"2024-04-13T02:45:28.465578+0000","last_became_peered":"2024-04-13T02:45:28.465578+0000","last_unstale":"2024-04-13T02:45:29.746346+0000","last_undegraded":"2024-04-13T02:45:29.746346+0000","last_fullsized":"2024-04-13T02:45:29.746346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:26:58.800046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457366+0000","last_change":"2024-04-13T02:45:27.460024+0000","last_active":"2024-04-13T02:45:29.457366+0000","last_peered":"2024-04-13T02:45:29.457366+0000","last_clean":"2024-04-13T02:45:29.457366+0000","last_became_active":"2024-04-13T02:45:27.459710+0000","last_became_peered":"2024-04-13T02:45:27.459710+0000","last_unstale":"2024-04-13T02:45:29.457366+0000","last_undegraded":"2024-04-13T02:45:29.457366+0000","last_fullsized":"2024-04-13T02:45:29.457366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:29:38.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462524+0000","last_change":"2024-04-13T02:45:28.462960+0000","last_active":"2024-04-13T02:45:29.462524+0000","last_peered":"2024-04-13T02:45:29.462524+0000","last_clean":"2024-04-13T02:45:29.462524+0000","last_became_active":"2024-04-13T02:45:28.462679+0000","last_became_peered":"2024-04-13T02:45:28.462679+0000","last_unstale":"2024-04-13T02:45:29.462524+0000","last_undegraded":"2024-04-13T02:45:29.462524+0000","last_fullsized":"2024-04-13T02:45:29.462524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:27:10.167308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463246+0000","last_change":"2024-04-13T02:45:27.458957+0000","last_active":"2024-04-13T02:45:29.463246+0000","last_peered":"2024-04-13T02:45:29.463246+0000","last_clean":"2024-04-13T02:45:29.463246+0000","last_became_active":"2024-04-13T02:45:27.458428+0000","last_became_peered":"2024-04-13T02:45:27.458428+0000","last_unstale":"2024-04-13T02:45:29.463246+0000","last_undegraded":"2024-04-13T02:45:29.463246+0000","last_fullsized":"2024-04-13T02:45:29.463246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:39.446763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745145+0000","last_change":"2024-04-13T02:45:28.470319+0000","last_active":"2024-04-13T02:45:29.745145+0000","last_peered":"2024-04-13T02:45:29.745145+0000","last_clean":"2024-04-13T02:45:29.745145+0000","last_became_active":"2024-04-13T02:45:28.469980+0000","last_became_peered":"2024-04-13T02:45:28.469980+0000","last_unstale":"2024-04-13T02:45:29.745145+0000","last_undegraded":"2024-04-13T02:45:29.745145+0000","last_fullsized":"2024-04-13T02:45:29.745145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:24:31.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462969+0000","last_change":"2024-04-13T02:45:27.459153+0000","last_active":"2024-04-13T02:45:29.462969+0000","last_peered":"2024-04-13T02:45:29.462969+0000","last_clean":"2024-04-13T02:45:29.462969+0000","last_became_active":"2024-04-13T02:45:27.458853+0000","last_became_peered":"2024-04-13T02:45:27.458853+0000","last_unstale":"2024-04-13T02:45:29.462969+0000","last_undegraded":"2024-04-13T02:45:29.462969+0000","last_fullsized":"2024-04-13T02:45:29.462969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463407+0000","last_change":"2024-04-13T02:45:28.456375+0000","last_active":"2024-04-13T02:45:29.463407+0000","last_peered":"2024-04-13T02:45:29.463407+0000","last_clean":"2024-04-13T02:45:29.463407+0000","last_became_active":"2024-04-13T02:45:28.455688+0000","last_became_peered":"2024-04-13T02:45:28.455688+0000","last_unstale":"2024-04-13T02:45:29.463407+0000","last_undegraded":"2024-04-13T02:45:29.463407+0000","last_fullsized":"2024-04-13T02:45:29.463407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:28:29.077431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744671+0000","last_change":"2024-04-13T02:45:27.457617+0000","last_active":"2024-04-13T02:45:29.744671+0000","last_peered":"2024-04-13T02:45:29.744671+0000","last_clean":"2024-04-13T02:45:29.744671+0000","last_became_active":"2024-04-13T02:45:27.457319+0000","last_became_peered":"2024-04-13T02:45:27.457319+0000","last_unstale":"2024-04-13T02:45:29.744671+0000","last_undegraded":"2024-04-13T02:45:29.744671+0000","last_fullsized":"2024-04-13T02:45:29.744671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:28:28.070154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745250+0000","last_change":"2024-04-13T02:45:28.464695+0000","last_active":"2024-04-13T02:45:29.745250+0000","last_peered":"2024-04-13T02:45:29.745250+0000","last_clean":"2024-04-13T02:45:29.745250+0000","last_became_active":"2024-04-13T02:45:28.464394+0000","last_became_peered":"2024-04-13T02:45:28.464394+0000","last_unstale":"2024-04-13T02:45:29.745250+0000","last_undegraded":"2024-04-13T02:45:29.745250+0000","last_fullsized":"2024-04-13T02:45:29.745250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:28:29.077431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463532+0000","last_change":"2024-04-13T02:45:27.463132+0000","last_active":"2024-04-13T02:45:29.463532+0000","last_peered":"2024-04-13T02:45:29.463532+0000","last_clean":"2024-04-13T02:45:29.463532+0000","last_became_active":"2024-04-13T02:45:27.462833+0000","last_became_peered":"2024-04-13T02:45:27.462833+0000","last_unstale":"2024-04-13T02:45:29.463532+0000","last_undegraded":"2024-04-13T02:45:29.463532+0000","last_fullsized":"2024-04-13T02:45:29.463532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:42:59.578144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745418+0000","last_change":"2024-04-13T02:45:28.470728+0000","last_active":"2024-04-13T02:45:29.745418+0000","last_peered":"2024-04-13T02:45:29.745418+0000","last_clean":"2024-04-13T02:45:29.745418+0000","last_became_active":"2024-04-13T02:45:28.470341+0000","last_became_peered":"2024-04-13T02:45:28.470341+0000","last_unstale":"2024-04-13T02:45:29.745418+0000","last_undegraded":"2024-04-13T02:45:29.745418+0000","last_fullsized":"2024-04-13T02:45:29.745418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:27:10.167308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745086+0000","last_change":"2024-04-13T02:45:27.456759+0000","last_active":"2024-04-13T02:45:29.745086+0000","last_peered":"2024-04-13T02:45:29.745086+0000","last_clean":"2024-04-13T02:45:29.745086+0000","last_became_active":"2024-04-13T02:45:27.456503+0000","last_became_peered":"2024-04-13T02:45:27.456503+0000","last_unstale":"2024-04-13T02:45:29.745086+0000","last_undegraded":"2024-04-13T02:45:29.745086+0000","last_fullsized":"2024-04-13T02:45:29.745086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:35:14.310990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744915+0000","last_change":"2024-04-13T02:45:28.461522+0000","last_active":"2024-04-13T02:45:29.744915+0000","last_peered":"2024-04-13T02:45:29.744915+0000","last_clean":"2024-04-13T02:45:29.744915+0000","last_became_active":"2024-04-13T02:45:28.461189+0000","last_became_peered":"2024-04-13T02:45:28.461189+0000","last_unstale":"2024-04-13T02:45:29.744915+0000","last_undegraded":"2024-04-13T02:45:29.744915+0000","last_fullsized":"2024-04-13T02:45:29.744915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:28:28.590600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746141+0000","last_change":"2024-04-13T02:45:27.458838+0000","last_active":"2024-04-13T02:45:29.746141+0000","last_peered":"2024-04-13T02:45:29.746141+0000","last_clean":"2024-04-13T02:45:29.746141+0000","last_became_active":"2024-04-13T02:45:27.458520+0000","last_became_peered":"2024-04-13T02:45:27.458520+0000","last_unstale":"2024-04-13T02:45:29.746141+0000","last_undegraded":"2024-04-13T02:45:29.746141+0000","last_fullsized":"2024-04-13T02:45:29.746141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:14:18.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745246+0000","last_change":"2024-04-13T02:45:28.460876+0000","last_active":"2024-04-13T02:45:29.745246+0000","last_peered":"2024-04-13T02:45:29.745246+0000","last_clean":"2024-04-13T02:45:29.745246+0000","last_became_active":"2024-04-13T02:45:28.460613+0000","last_became_peered":"2024-04-13T02:45:28.460613+0000","last_unstale":"2024-04-13T02:45:29.745246+0000","last_undegraded":"2024-04-13T02:45:29.745246+0000","last_fullsized":"2024-04-13T02:45:29.745246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:57:20.677567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745532+0000","last_change":"2024-04-13T02:45:27.463079+0000","last_active":"2024-04-13T02:45:29.745532+0000","last_peered":"2024-04-13T02:45:29.745532+0000","last_clean":"2024-04-13T02:45:29.745532+0000","last_became_active":"2024-04-13T02:45:27.461886+0000","last_became_peered":"2024-04-13T02:45:27.461886+0000","last_unstale":"2024-04-13T02:45:29.745532+0000","last_undegraded":"2024-04-13T02:45:29.745532+0000","last_fullsized":"2024-04-13T02:45:29.745532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:28:06.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745115+0000","last_change":"2024-04-13T02:45:28.473509+0000","last_active":"2024-04-13T02:45:29.745115+0000","last_peered":"2024-04-13T02:45:29.745115+0000","last_clean":"2024-04-13T02:45:29.745115+0000","last_became_active":"2024-04-13T02:45:28.472737+0000","last_became_peered":"2024-04-13T02:45:28.472737+0000","last_unstale":"2024-04-13T02:45:29.745115+0000","last_undegraded":"2024-04-13T02:45:29.745115+0000","last_fullsized":"2024-04-13T02:45:29.745115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T09:45:07.117490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745204+0000","last_change":"2024-04-13T02:45:27.460661+0000","last_active":"2024-04-13T02:45:29.745204+0000","last_peered":"2024-04-13T02:45:29.745204+0000","last_clean":"2024-04-13T02:45:29.745204+0000","last_became_active":"2024-04-13T02:45:27.460173+0000","last_became_peered":"2024-04-13T02:45:27.460173+0000","last_unstale":"2024-04-13T02:45:29.745204+0000","last_undegraded":"2024-04-13T02:45:29.745204+0000","last_fullsized":"2024-04-13T02:45:29.745204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:36:34.130815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745446+0000","last_change":"2024-04-13T02:45:28.473350+0000","last_active":"2024-04-13T02:45:29.745446+0000","last_peered":"2024-04-13T02:45:29.745446+0000","last_clean":"2024-04-13T02:45:29.745446+0000","last_became_active":"2024-04-13T02:45:28.473083+0000","last_became_peered":"2024-04-13T02:45:28.473083+0000","last_unstale":"2024-04-13T02:45:29.745446+0000","last_undegraded":"2024-04-13T02:45:29.745446+0000","last_fullsized":"2024-04-13T02:45:29.745446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:47:22.644847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463660+0000","last_change":"2024-04-13T02:45:27.463704+0000","last_active":"2024-04-13T02:45:29.463660+0000","last_peered":"2024-04-13T02:45:29.463660+0000","last_clean":"2024-04-13T02:45:29.463660+0000","last_became_active":"2024-04-13T02:45:27.463451+0000","last_became_peered":"2024-04-13T02:45:27.463451+0000","last_unstale":"2024-04-13T02:45:29.463660+0000","last_undegraded":"2024-04-13T02:45:29.463660+0000","last_fullsized":"2024-04-13T02:45:29.463660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:04.643384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745053+0000","last_change":"2024-04-13T02:45:28.454438+0000","last_active":"2024-04-13T02:45:29.745053+0000","last_peered":"2024-04-13T02:45:29.745053+0000","last_clean":"2024-04-13T02:45:29.745053+0000","last_became_active":"2024-04-13T02:45:28.454181+0000","last_became_peered":"2024-04-13T02:45:28.454181+0000","last_unstale":"2024-04-13T02:45:29.745053+0000","last_undegraded":"2024-04-13T02:45:29.745053+0000","last_fullsized":"2024-04-13T02:45:29.745053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:39:25.759872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745525+0000","last_change":"2024-04-13T02:45:27.455259+0000","last_active":"2024-04-13T02:45:29.745525+0000","last_peered":"2024-04-13T02:45:29.745525+0000","last_clean":"2024-04-13T02:45:29.745525+0000","last_became_active":"2024-04-13T02:45:27.454963+0000","last_became_peered":"2024-04-13T02:45:27.454963+0000","last_unstale":"2024-04-13T02:45:29.745525+0000","last_undegraded":"2024-04-13T02:45:29.745525+0000","last_fullsized":"2024-04-13T02:45:29.745525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:02:49.686852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462490+0000","last_change":"2024-04-13T02:45:28.463271+0000","last_active":"2024-04-13T02:45:29.462490+0000","last_peered":"2024-04-13T02:45:29.462490+0000","last_clean":"2024-04-13T02:45:29.462490+0000","last_became_active":"2024-04-13T02:45:28.462563+0000","last_became_peered":"2024-04-13T02:45:28.462563+0000","last_unstale":"2024-04-13T02:45:29.462490+0000","last_undegraded":"2024-04-13T02:45:29.462490+0000","last_fullsized":"2024-04-13T02:45:29.462490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:12:54.424678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744679+0000","last_change":"2024-04-13T02:45:27.456096+0000","last_active":"2024-04-13T02:45:29.744679+0000","last_peered":"2024-04-13T02:45:29.744679+0000","last_clean":"2024-04-13T02:45:29.744679+0000","last_became_active":"2024-04-13T02:45:27.455814+0000","last_became_peered":"2024-04-13T02:45:27.455814+0000","last_unstale":"2024-04-13T02:45:29.744679+0000","last_undegraded":"2024-04-13T02:45:29.744679+0000","last_fullsized":"2024-04-13T02:45:29.744679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:47:21.637569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746056+0000","last_change":"2024-04-13T02:45:28.462892+0000","last_active":"2024-04-13T02:45:29.746056+0000","last_peered":"2024-04-13T02:45:29.746056+0000","last_clean":"2024-04-13T02:45:29.746056+0000","last_became_active":"2024-04-13T02:45:28.462601+0000","last_became_peered":"2024-04-13T02:45:28.462601+0000","last_unstale":"2024-04-13T02:45:29.746056+0000","last_undegraded":"2024-04-13T02:45:29.746056+0000","last_fullsized":"2024-04-13T02:45:29.746056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:57:25.386062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744626+0000","last_change":"2024-04-13T02:45:27.461165+0000","last_active":"2024-04-13T02:45:29.744626+0000","last_peered":"2024-04-13T02:45:29.744626+0000","last_clean":"2024-04-13T02:45:29.744626+0000","last_became_active":"2024-04-13T02:45:27.460919+0000","last_became_peered":"2024-04-13T02:45:27.460919+0000","last_unstale":"2024-04-13T02:45:29.744626+0000","last_undegraded":"2024-04-13T02:45:29.744626+0000","last_fullsized":"2024-04-13T02:45:29.744626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:28:06.481048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462695+0000","last_change":"2024-04-13T02:45:28.463724+0000","last_active":"2024-04-13T02:45:29.462695+0000","last_peered":"2024-04-13T02:45:29.462695+0000","last_clean":"2024-04-13T02:45:29.462695+0000","last_became_active":"2024-04-13T02:45:28.462956+0000","last_became_peered":"2024-04-13T02:45:28.462956+0000","last_unstale":"2024-04-13T02:45:29.462695+0000","last_undegraded":"2024-04-13T02:45:29.462695+0000","last_fullsized":"2024-04-13T02:45:29.462695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:43.427671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746309+0000","last_change":"2024-04-13T02:45:27.456385+0000","last_active":"2024-04-13T02:45:29.746309+0000","last_peered":"2024-04-13T02:45:29.746309+0000","last_clean":"2024-04-13T02:45:29.746309+0000","last_became_active":"2024-04-13T02:45:27.456119+0000","last_became_peered":"2024-04-13T02:45:27.456119+0000","last_unstale":"2024-04-13T02:45:29.746309+0000","last_undegraded":"2024-04-13T02:45:29.746309+0000","last_fullsized":"2024-04-13T02:45:29.746309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:04:37.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745421+0000","last_change":"2024-04-13T02:45:28.468291+0000","last_active":"2024-04-13T02:45:29.745421+0000","last_peered":"2024-04-13T02:45:29.745421+0000","last_clean":"2024-04-13T02:45:29.745421+0000","last_became_active":"2024-04-13T02:45:28.467956+0000","last_became_peered":"2024-04-13T02:45:28.467956+0000","last_unstale":"2024-04-13T02:45:29.745421+0000","last_undegraded":"2024-04-13T02:45:29.745421+0000","last_fullsized":"2024-04-13T02:45:29.745421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:47:46.368092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462762+0000","last_change":"2024-04-13T02:45:27.462257+0000","last_active":"2024-04-13T02:45:29.462762+0000","last_peered":"2024-04-13T02:45:29.462762+0000","last_clean":"2024-04-13T02:45:29.462762+0000","last_became_active":"2024-04-13T02:45:27.461973+0000","last_became_peered":"2024-04-13T02:45:27.461973+0000","last_unstale":"2024-04-13T02:45:29.462762+0000","last_undegraded":"2024-04-13T02:45:29.462762+0000","last_fullsized":"2024-04-13T02:45:29.462762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746086+0000","last_change":"2024-04-13T02:45:28.464747+0000","last_active":"2024-04-13T02:45:29.746086+0000","last_peered":"2024-04-13T02:45:29.746086+0000","last_clean":"2024-04-13T02:45:29.746086+0000","last_became_active":"2024-04-13T02:45:28.464500+0000","last_became_peered":"2024-04-13T02:45:28.464500+0000","last_unstale":"2024-04-13T02:45:29.746086+0000","last_undegraded":"2024-04-13T02:45:29.746086+0000","last_fullsized":"2024-04-13T02:45:29.746086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:36:35.138092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463250+0000","last_change":"2024-04-13T02:45:27.463019+0000","last_active":"2024-04-13T02:45:29.463250+0000","last_peered":"2024-04-13T02:45:29.463250+0000","last_clean":"2024-04-13T02:45:29.463250+0000","last_became_active":"2024-04-13T02:45:27.462366+0000","last_became_peered":"2024-04-13T02:45:27.462366+0000","last_unstale":"2024-04-13T02:45:29.463250+0000","last_undegraded":"2024-04-13T02:45:29.463250+0000","last_fullsized":"2024-04-13T02:45:29.463250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T11:56:57.986111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457271+0000","last_change":"2024-04-13T02:45:28.456083+0000","last_active":"2024-04-13T02:45:29.457271+0000","last_peered":"2024-04-13T02:45:29.457271+0000","last_clean":"2024-04-13T02:45:29.457271+0000","last_became_active":"2024-04-13T02:45:28.455821+0000","last_became_peered":"2024-04-13T02:45:28.455821+0000","last_unstale":"2024-04-13T02:45:29.457271+0000","last_undegraded":"2024-04-13T02:45:29.457271+0000","last_fullsized":"2024-04-13T02:45:29.457271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:48:05.650662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463448+0000","last_change":"2024-04-13T02:45:27.463016+0000","last_active":"2024-04-13T02:45:29.463448+0000","last_peered":"2024-04-13T02:45:29.463448+0000","last_clean":"2024-04-13T02:45:29.463448+0000","last_became_active":"2024-04-13T02:45:27.462717+0000","last_became_peered":"2024-04-13T02:45:27.462717+0000","last_unstale":"2024-04-13T02:45:29.463448+0000","last_undegraded":"2024-04-13T02:45:29.463448+0000","last_fullsized":"2024-04-13T02:45:29.463448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457395+0000","last_change":"2024-04-13T02:45:28.457875+0000","last_active":"2024-04-13T02:45:29.457395+0000","last_peered":"2024-04-13T02:45:29.457395+0000","last_clean":"2024-04-13T02:45:29.457395+0000","last_became_active":"2024-04-13T02:45:28.457583+0000","last_became_peered":"2024-04-13T02:45:28.457583+0000","last_unstale":"2024-04-13T02:45:29.457395+0000","last_undegraded":"2024-04-13T02:45:29.457395+0000","last_fullsized":"2024-04-13T02:45:29.457395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:25.459560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745818+0000","last_change":"2024-04-13T02:45:27.457724+0000","last_active":"2024-04-13T02:45:29.745818+0000","last_peered":"2024-04-13T02:45:29.745818+0000","last_clean":"2024-04-13T02:45:29.745818+0000","last_became_active":"2024-04-13T02:45:27.457432+0000","last_became_peered":"2024-04-13T02:45:27.457432+0000","last_unstale":"2024-04-13T02:45:29.745818+0000","last_undegraded":"2024-04-13T02:45:29.745818+0000","last_fullsized":"2024-04-13T02:45:29.745818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:44.850435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457473+0000","last_change":"2024-04-13T02:45:28.459102+0000","last_active":"2024-04-13T02:45:29.457473+0000","last_peered":"2024-04-13T02:45:29.457473+0000","last_clean":"2024-04-13T02:45:29.457473+0000","last_became_active":"2024-04-13T02:45:28.458475+0000","last_became_peered":"2024-04-13T02:45:28.458475+0000","last_unstale":"2024-04-13T02:45:29.457473+0000","last_undegraded":"2024-04-13T02:45:29.457473+0000","last_fullsized":"2024-04-13T02:45:29.457473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:46:45.857713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745799+0000","last_change":"2024-04-13T02:45:27.460601+0000","last_active":"2024-04-13T02:45:29.745799+0000","last_peered":"2024-04-13T02:45:29.745799+0000","last_clean":"2024-04-13T02:45:29.745799+0000","last_became_active":"2024-04-13T02:45:27.460291+0000","last_became_peered":"2024-04-13T02:45:27.460291+0000","last_unstale":"2024-04-13T02:45:29.745799+0000","last_undegraded":"2024-04-13T02:45:29.745799+0000","last_fullsized":"2024-04-13T02:45:29.745799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:04:11.570367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457198+0000","last_change":"2024-04-13T02:45:28.453027+0000","last_active":"2024-04-13T02:45:29.457198+0000","last_peered":"2024-04-13T02:45:29.457198+0000","last_clean":"2024-04-13T02:45:29.457198+0000","last_became_active":"2024-04-13T02:45:28.452701+0000","last_became_peered":"2024-04-13T02:45:28.452701+0000","last_unstale":"2024-04-13T02:45:29.457198+0000","last_undegraded":"2024-04-13T02:45:29.457198+0000","last_fullsized":"2024-04-13T02:45:29.457198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:03:26.545147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463361+0000","last_change":"2024-04-13T02:45:27.460370+0000","last_active":"2024-04-13T02:45:29.463361+0000","last_peered":"2024-04-13T02:45:29.463361+0000","last_clean":"2024-04-13T02:45:29.463361+0000","last_became_active":"2024-04-13T02:45:27.460094+0000","last_became_peered":"2024-04-13T02:45:27.460094+0000","last_unstale":"2024-04-13T02:45:29.463361+0000","last_undegraded":"2024-04-13T02:45:29.463361+0000","last_fullsized":"2024-04-13T02:45:29.463361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:03:25.537870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463015+0000","last_change":"2024-04-13T02:45:28.456773+0000","last_active":"2024-04-13T02:45:29.463015+0000","last_peered":"2024-04-13T02:45:29.463015+0000","last_clean":"2024-04-13T02:45:29.463015+0000","last_became_active":"2024-04-13T02:45:28.456505+0000","last_became_peered":"2024-04-13T02:45:28.456505+0000","last_unstale":"2024-04-13T02:45:29.463015+0000","last_undegraded":"2024-04-13T02:45:29.463015+0000","last_fullsized":"2024-04-13T02:45:29.463015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:28:28.590600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744813+0000","last_change":"2024-04-13T02:45:27.461869+0000","last_active":"2024-04-13T02:45:29.744813+0000","last_peered":"2024-04-13T02:45:29.744813+0000","last_clean":"2024-04-13T02:45:29.744813+0000","last_became_active":"2024-04-13T02:45:27.461565+0000","last_became_peered":"2024-04-13T02:45:27.461565+0000","last_unstale":"2024-04-13T02:45:29.744813+0000","last_undegraded":"2024-04-13T02:45:29.744813+0000","last_fullsized":"2024-04-13T02:45:29.744813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:49:42.420394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.457290+0000","last_change":"2024-04-13T02:45:28.463142+0000","last_active":"2024-04-13T02:45:29.457290+0000","last_peered":"2024-04-13T02:45:29.457290+0000","last_clean":"2024-04-13T02:45:29.457290+0000","last_became_active":"2024-04-13T02:45:28.462832+0000","last_became_peered":"2024-04-13T02:45:28.462832+0000","last_unstale":"2024-04-13T02:45:29.457290+0000","last_undegraded":"2024-04-13T02:45:29.457290+0000","last_fullsized":"2024-04-13T02:45:29.457290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T13:38:40.454041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746330+0000","last_change":"2024-04-13T02:45:27.459353+0000","last_active":"2024-04-13T02:45:29.746330+0000","last_peered":"2024-04-13T02:45:29.746330+0000","last_clean":"2024-04-13T02:45:29.746330+0000","last_became_active":"2024-04-13T02:45:27.459099+0000","last_became_peered":"2024-04-13T02:45:27.459099+0000","last_unstale":"2024-04-13T02:45:29.746330+0000","last_undegraded":"2024-04-13T02:45:29.746330+0000","last_fullsized":"2024-04-13T02:45:29.746330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:01:31.847609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745593+0000","last_change":"2024-04-13T02:45:28.468961+0000","last_active":"2024-04-13T02:45:29.745593+0000","last_peered":"2024-04-13T02:45:29.745593+0000","last_clean":"2024-04-13T02:45:29.745593+0000","last_became_active":"2024-04-13T02:45:28.468722+0000","last_became_peered":"2024-04-13T02:45:28.468722+0000","last_unstale":"2024-04-13T02:45:29.745593+0000","last_undegraded":"2024-04-13T02:45:29.745593+0000","last_fullsized":"2024-04-13T02:45:29.745593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:06:52.449798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746165+0000","last_change":"2024-04-13T02:45:27.453586+0000","last_active":"2024-04-13T02:45:29.746165+0000","last_peered":"2024-04-13T02:45:29.746165+0000","last_clean":"2024-04-13T02:45:29.746165+0000","last_became_active":"2024-04-13T02:45:27.453276+0000","last_became_peered":"2024-04-13T02:45:27.453276+0000","last_unstale":"2024-04-13T02:45:29.746165+0000","last_undegraded":"2024-04-13T02:45:29.746165+0000","last_fullsized":"2024-04-13T02:45:29.746165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:04:37.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745729+0000","last_change":"2024-04-13T02:45:28.456344+0000","last_active":"2024-04-13T02:45:29.745729+0000","last_peered":"2024-04-13T02:45:29.745729+0000","last_clean":"2024-04-13T02:45:29.745729+0000","last_became_active":"2024-04-13T02:45:28.456038+0000","last_became_peered":"2024-04-13T02:45:28.456038+0000","last_unstale":"2024-04-13T02:45:29.745729+0000","last_undegraded":"2024-04-13T02:45:29.745729+0000","last_fullsized":"2024-04-13T02:45:29.745729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:28:07.488326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.746169+0000","last_change":"2024-04-13T02:45:27.456466+0000","last_active":"2024-04-13T02:45:29.746169+0000","last_peered":"2024-04-13T02:45:29.746169+0000","last_clean":"2024-04-13T02:45:29.746169+0000","last_became_active":"2024-04-13T02:45:27.456102+0000","last_became_peered":"2024-04-13T02:45:27.456102+0000","last_unstale":"2024-04-13T02:45:29.746169+0000","last_undegraded":"2024-04-13T02:45:29.746169+0000","last_fullsized":"2024-04-13T02:45:29.746169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:37:05.818923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745634+0000","last_change":"2024-04-13T02:45:28.459558+0000","last_active":"2024-04-13T02:45:29.745634+0000","last_peered":"2024-04-13T02:45:29.745634+0000","last_clean":"2024-04-13T02:45:29.745634+0000","last_became_active":"2024-04-13T02:45:28.459281+0000","last_became_peered":"2024-04-13T02:45:28.459281+0000","last_unstale":"2024-04-13T02:45:29.745634+0000","last_undegraded":"2024-04-13T02:45:29.745634+0000","last_fullsized":"2024-04-13T02:45:29.745634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:37:53.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745997+0000","last_change":"2024-04-13T02:45:27.458418+0000","last_active":"2024-04-13T02:45:29.745997+0000","last_peered":"2024-04-13T02:45:29.745997+0000","last_clean":"2024-04-13T02:45:29.745997+0000","last_became_active":"2024-04-13T02:45:27.458118+0000","last_became_peered":"2024-04-13T02:45:27.458118+0000","last_unstale":"2024-04-13T02:45:29.745997+0000","last_undegraded":"2024-04-13T02:45:29.745997+0000","last_fullsized":"2024-04-13T02:45:29.745997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:02:49.686852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745842+0000","last_change":"2024-04-13T02:45:28.455633+0000","last_active":"2024-04-13T02:45:29.745842+0000","last_peered":"2024-04-13T02:45:29.745842+0000","last_clean":"2024-04-13T02:45:29.745842+0000","last_became_active":"2024-04-13T02:45:28.455265+0000","last_became_peered":"2024-04-13T02:45:28.455265+0000","last_unstale":"2024-04-13T02:45:29.745842+0000","last_undegraded":"2024-04-13T02:45:29.745842+0000","last_fullsized":"2024-04-13T02:45:29.745842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:22:33.297459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745607+0000","last_change":"2024-04-13T02:45:27.458631+0000","last_active":"2024-04-13T02:45:29.745607+0000","last_peered":"2024-04-13T02:45:29.745607+0000","last_clean":"2024-04-13T02:45:29.745607+0000","last_became_active":"2024-04-13T02:45:27.458346+0000","last_became_peered":"2024-04-13T02:45:27.458346+0000","last_unstale":"2024-04-13T02:45:29.745607+0000","last_undegraded":"2024-04-13T02:45:29.745607+0000","last_fullsized":"2024-04-13T02:45:29.745607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T08:14:18.514130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744687+0000","last_change":"2024-04-13T02:45:28.453674+0000","last_active":"2024-04-13T02:45:29.744687+0000","last_peered":"2024-04-13T02:45:29.744687+0000","last_clean":"2024-04-13T02:45:29.744687+0000","last_became_active":"2024-04-13T02:45:28.453006+0000","last_became_peered":"2024-04-13T02:45:28.453006+0000","last_unstale":"2024-04-13T02:45:29.744687+0000","last_undegraded":"2024-04-13T02:45:29.744687+0000","last_fullsized":"2024-04-13T02:45:29.744687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:27:10.167308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463511+0000","last_change":"2024-04-13T02:45:27.459295+0000","last_active":"2024-04-13T02:45:29.463511+0000","last_peered":"2024-04-13T02:45:29.463511+0000","last_clean":"2024-04-13T02:45:29.463511+0000","last_became_active":"2024-04-13T02:45:27.459013+0000","last_became_peered":"2024-04-13T02:45:27.459013+0000","last_unstale":"2024-04-13T02:45:29.463511+0000","last_undegraded":"2024-04-13T02:45:29.463511+0000","last_fullsized":"2024-04-13T02:45:29.463511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T10:29:20.534541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.463250+0000","last_change":"2024-04-13T02:45:28.462258+0000","last_active":"2024-04-13T02:45:29.463250+0000","last_peered":"2024-04-13T02:45:29.463250+0000","last_clean":"2024-04-13T02:45:29.463250+0000","last_became_active":"2024-04-13T02:45:28.461649+0000","last_became_peered":"2024-04-13T02:45:28.461649+0000","last_unstale":"2024-04-13T02:45:29.463250+0000","last_undegraded":"2024-04-13T02:45:29.463250+0000","last_fullsized":"2024-04-13T02:45:29.463250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T14:35:15.318268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.744791+0000","last_change":"2024-04-13T02:45:27.455763+0000","last_active":"2024-04-13T02:45:29.744791+0000","last_peered":"2024-04-13T02:45:29.744791+0000","last_clean":"2024-04-13T02:45:29.744791+0000","last_became_active":"2024-04-13T02:45:27.455501+0000","last_became_peered":"2024-04-13T02:45:27.455501+0000","last_unstale":"2024-04-13T02:45:29.744791+0000","last_undegraded":"2024-04-13T02:45:29.744791+0000","last_fullsized":"2024-04-13T02:45:29.744791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T12:22:32.290181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462721+0000","last_change":"2024-04-13T02:45:28.453491+0000","last_active":"2024-04-13T02:45:29.462721+0000","last_peered":"2024-04-13T02:45:29.462721+0000","last_clean":"2024-04-13T02:45:29.462721+0000","last_became_active":"2024-04-13T02:45:28.453141+0000","last_became_peered":"2024-04-13T02:45:28.453141+0000","last_unstale":"2024-04-13T02:45:29.462721+0000","last_undegraded":"2024-04-13T02:45:29.462721+0000","last_fullsized":"2024-04-13T02:45:29.462721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:27.434421+0000","last_clean_scrub_stamp":"2024-04-13T02:45:27.434421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T05:06:52.449798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.745362+0000","last_change":"2024-04-13T02:45:27.457081+0000","last_active":"2024-04-13T02:45:29.745362+0000","last_peered":"2024-04-13T02:45:29.745362+0000","last_clean":"2024-04-13T02:45:29.745362+0000","last_became_active":"2024-04-13T02:45:27.456809+0000","last_became_peered":"2024-04-13T02:45:27.456809+0000","last_unstale":"2024-04-13T02:45:29.745362+0000","last_undegraded":"2024-04-13T02:45:29.745362+0000","last_fullsized":"2024-04-13T02:45:29.745362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:45:26.427143+0000","last_clean_scrub_stamp":"2024-04-13T02:45:26.427143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:39:24.452282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-13T02:45:29.462745+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:45:29.462745+0000","last_peered":"2024-04-13T02:45:29.462745+0000","last_clean":"2024-04-13T02:45:29.462745+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:45:29.462745+0000","last_undegraded":"2024-04-13T02:45:29.462745+0000","last_fullsized":"2024-04-13T02:45:29.462745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":135066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":135122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":136084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:45:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-13T02:45:36.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-13T02:45:36.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.288+0000 7fb518f55640 1 Processor -- start 2024-04-13T02:45:36.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.288+0000 7fb518f55640 1 -- start start 2024-04-13T02:45:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.289+0000 7fb518f55640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 0x7fb5140d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.289+0000 7fb518f55640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 0x7fb5140cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.289+0000 7fb518f55640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5140ba4d0 con 0x7fb5140d3270 2024-04-13T02:45:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.289+0000 7fb518f55640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb51415f0a0 con 0x7fb5140b3720 2024-04-13T02:45:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.289+0000 7fb518f55640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb5140ba280 con 0x7fb51415ecc0 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb51259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 0x7fb5140d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb512d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 0x7fb5140cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb512d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 0x7fb5140cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:35948/0 (socket says 172.21.15.114:35948) 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb51259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 0x7fb5140d2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:53110/0 (socket says 172.21.15.114:53110) 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb512d9d640 1 -- 172.21.15.114:0/1532570232 learned_addr learned my addr 172.21.15.114:0/1532570232 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb511d9b640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb5140d3270 0x7fb5140b95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:49652/0 (socket says 172.21.15.114:49652) 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb51259c640 1 -- 172.21.15.114:0/1532570232 >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 msgr2=0x7fb5140cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb51259c640 1 --2- 172.21.15.114:0/1532570232 >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 0x7fb5140cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb51259c640 1 -- 172.21.15.114:0/1532570232 >> v1:172.21.15.130:6789/0 conn(0x7fb5140d3270 legacy=0x7fb5140b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb51259c640 1 -- 172.21.15.114:0/1532570232 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5140ba7b0 con 0x7fb51415ecc0 2024-04-13T02:45:36.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.290+0000 7fb512d9d640 1 --2- 172.21.15.114:0/1532570232 >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 0x7fb5140cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.291+0000 7fb51259c640 1 --2- 172.21.15.114:0/1532570232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 0x7fb5140d2d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb504009d90 tx=0x7fb50402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513429b92a6f145e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.291+0000 7fb51159a640 1 -- 172.21.15.114:0/1532570232 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504039070 con 0x7fb51415ecc0 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.291+0000 7fb51159a640 1 -- 172.21.15.114:0/1532570232 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50402cc50 con 0x7fb51415ecc0 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.291+0000 7fb51159a640 1 -- 172.21.15.114:0/1532570232 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504034440 con 0x7fb51415ecc0 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.291+0000 7fb518f55640 1 -- 172.21.15.114:0/1532570232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 msgr2=0x7fb5140d2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.291+0000 7fb518f55640 1 --2- 172.21.15.114:0/1532570232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 0x7fb5140d2d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb504009d90 tx=0x7fb50402bea0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.292+0000 7fb518f55640 1 -- 172.21.15.114:0/1532570232 shutdown_connections 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.292+0000 7fb518f55640 1 --2- 172.21.15.114:0/1532570232 >> v2:172.21.15.130:3300/0 conn(0x7fb5140b3720 0x7fb5140cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.292+0000 7fb518f55640 1 --2- 172.21.15.114:0/1532570232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb51415ecc0 0x7fb5140d2d30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.292+0000 7fb518f55640 1 -- 172.21.15.114:0/1532570232 >> 172.21.15.114:0/1532570232 conn(0x7fb514073480 msgr2=0x7fb514073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.292+0000 7fb518f55640 1 -- 172.21.15.114:0/1532570232 shutdown_connections 2024-04-13T02:45:36.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.292+0000 7fb518f55640 1 -- 172.21.15.114:0/1532570232 wait complete. 2024-04-13T02:45:36.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.293+0000 7fb518f55640 1 Processor -- start 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.293+0000 7fb518f55640 1 -- start start 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb518f55640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5140b3720 0x7fb514155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb518f55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 0x7fb5141f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb518f55640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51415ecc0 0x7fb5140cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb518f55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb5140b8aa0 con 0x7fb5140d3270 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb518f55640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5140b90d0 con 0x7fb51415ecc0 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb518f55640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb5140b9d00 con 0x7fb5140b3720 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 0x7fb5141f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 0x7fb5141f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43264/0 (socket says 172.21.15.114:43264) 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 -- 172.21.15.114:0/3013445468 learned_addr learned my addr 172.21.15.114:0/3013445468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb51259c640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5140b3720 0x7fb514155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb512d9d640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51415ecc0 0x7fb5140cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 -- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5140b3720 msgr2=0x7fb514155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5140b3720 0x7fb514155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 -- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51415ecc0 msgr2=0x7fb5140cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51415ecc0 0x7fb5140cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 -- 172.21.15.114:0/3013445468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5140c9640 con 0x7fb5140d3270 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb511d9b640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 0x7fb5141f4c70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c430 tx=0x7fb50800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.294+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5080074e0 con 0x7fb5140d3270 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.295+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb508007680 con 0x7fb5140d3270 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.295+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5140c9920 con 0x7fb5140d3270 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.295+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508004a00 con 0x7fb5140d3270 2024-04-13T02:45:36.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.295+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5140cc580 con 0x7fb5140d3270 2024-04-13T02:45:36.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.296+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb514068c80 con 0x7fb5140d3270 2024-04-13T02:45:36.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.296+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb50801a020 con 0x7fb5140d3270 2024-04-13T02:45:36.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.296+0000 7fb502ffd640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4f406c8f0 0x7fb4f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.296+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb50808b2b0 con 0x7fb5140d3270 2024-04-13T02:45:36.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.296+0000 7fb51259c640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4f406c8f0 0x7fb4f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.297+0000 7fb51259c640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4f406c8f0 0x7fb4f406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb504036000 tx=0x7fb504030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:36.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.301+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb508059010 con 0x7fb5140d3270 2024-04-13T02:45:36.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.550+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb5140d3050 con 0x7fb5140d3270 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.554+0000 7fb502ffd640 1 -- 172.21.15.114:0/3013445468 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fb50805d310 con 0x7fb5140d3270 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBY8RlmJv83ORAAjDE2/qy1zVmJSBcoX42cng== 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-13T02:45:36.555 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4f406c8f0 msgr2=0x7fb4f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4f406c8f0 0x7fb4f406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb504036000 tx=0x7fb504030000 comp rx=0 tx=0).stop 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 msgr2=0x7fb5141f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 0x7fb5141f4c70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c430 tx=0x7fb50800c8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 shutdown_connections 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb51415ecc0 0x7fb5140cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5140d3270 0x7fb5141f4c70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb4f406c8f0 0x7fb4f406edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 --2- 172.21.15.114:0/3013445468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb5140b3720 0x7fb514155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.556+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 >> 172.21.15.114:0/3013445468 conn(0x7fb514073480 msgr2=0x7fb5140d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:36.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.557+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 shutdown_connections 2024-04-13T02:45:36.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.557+0000 7fb518f55640 1 -- 172.21.15.114:0/3013445468 wait complete. 2024-04-13T02:45:36.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.666+0000 7f8a922c8640 1 Processor -- start 2024-04-13T02:45:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.666+0000 7f8a922c8640 1 -- start start 2024-04-13T02:45:36.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a922c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c1461f0 0x7f8a8c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a922c8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a8c0cedf0 0x7f8a8c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a922c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a8c0b4be0 con 0x7f8a8c0b3e10 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a922c8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8c0a9640 con 0x7f8a8c0cedf0 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a922c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8c0cf250 con 0x7f8a8c1461f0 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a8b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a8c0cedf0 0x7f8a8c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a90865640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8a8c0b3e10 0x7f8a8c0cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44946/0 (socket says 172.21.15.114:44946) 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a90865640 1 -- 172.21.15.114:0/432914014 learned_addr learned my addr 172.21.15.114:0/432914014 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.667+0000 7f8a8bfff640 1 --2- 172.21.15.114:0/432914014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c1461f0 0x7f8a8c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8b7fe640 1 -- 172.21.15.114:0/432914014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c1461f0 msgr2=0x7f8a8c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8b7fe640 1 --2- 172.21.15.114:0/432914014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c1461f0 0x7f8a8c0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8b7fe640 1 -- 172.21.15.114:0/432914014 >> v1:172.21.15.114:6789/0 conn(0x7f8a8c0b3e10 legacy=0x7f8a8c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8affd640 1 -- 172.21.15.114:0/432914014 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534690688 0 0) 0x7f8a8c0b4be0 con 0x7f8a8c0b3e10 2024-04-13T02:45:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8b7fe640 1 -- 172.21.15.114:0/432914014 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c0b4620 con 0x7f8a8c0cedf0 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8b7fe640 1 --2- 172.21.15.114:0/432914014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c0b38d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097d0 tx=0x7f8a8002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7210232abaaae8ad server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.668+0000 7f8a8affd640 1 -- 172.21.15.114:0/432914014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80035020 con 0x7f8a8c0cedf0 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a8affd640 1 -- 172.21.15.114:0/432914014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80031800 con 0x7f8a8c0cedf0 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a8affd640 1 -- 172.21.15.114:0/432914014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80031bd0 con 0x7f8a8c0cedf0 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 -- 172.21.15.114:0/432914014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c0cedf0 msgr2=0x7f8a8c0b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 --2- 172.21.15.114:0/432914014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c0b38d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097d0 tx=0x7f8a8002b8a0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 -- 172.21.15.114:0/432914014 shutdown_connections 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 --2- 172.21.15.114:0/432914014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c0b38d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 --2- 172.21.15.114:0/432914014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c1461f0 0x7f8a8c0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 -- 172.21.15.114:0/432914014 >> 172.21.15.114:0/432914014 conn(0x7f8a8c0b27b0 msgr2=0x7f8a8c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 -- 172.21.15.114:0/432914014 shutdown_connections 2024-04-13T02:45:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.669+0000 7f8a922c8640 1 -- 172.21.15.114:0/432914014 wait complete. 2024-04-13T02:45:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.670+0000 7f8a922c8640 1 Processor -- start 2024-04-13T02:45:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.670+0000 7f8a922c8640 1 -- start start 2024-04-13T02:45:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a922c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c0b3e10 0x7f8a8c1436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a922c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a922c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 0x7f8a8c13d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a922c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c15d290 con 0x7f8a8c1461f0 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a922c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c15cfb0 con 0x7f8a8c0cedf0 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a922c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8c1465d0 con 0x7f8a8c0b3e10 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 0x7f8a8c13d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 0x7f8a8c13d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43286/0 (socket says 172.21.15.114:43286) 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 -- 172.21.15.114:0/2643052493 learned_addr learned my addr 172.21.15.114:0/2643052493 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a8b7fe640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a8bfff640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c0b3e10 0x7f8a8c1436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 -- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c0b3e10 msgr2=0x7f8a8c1436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c0b3e10 0x7f8a8c1436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 -- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a8c0cedf0 msgr2=0x7f8a8c14ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c14ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.671+0000 7f8a90865640 1 -- 172.21.15.114:0/2643052493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c143ed0 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.672+0000 7f8a90865640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 0x7f8a8c13d110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c7a0 tx=0x7f8a8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.672+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84018070 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.672+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8400a640 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.672+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8c1441b0 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.672+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400aab0 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.672+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8c0ae960 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.673+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8c068c80 con 0x7f8a8c1461f0 2024-04-13T02:45:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.673+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a8401b070 con 0x7f8a8c1461f0 2024-04-13T02:45:36.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.674+0000 7f8a88ff9640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a7806c8f0 0x7f8a7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:36.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.674+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8a8408b140 con 0x7f8a8c1461f0 2024-04-13T02:45:36.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.674+0000 7f8a8bfff640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a7806c8f0 0x7f8a7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:36.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.674+0000 7f8a8bfff640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a7806c8f0 0x7f8a7806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c006fd0 tx=0x7f8a7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:36.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.678+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a84059570 con 0x7f8a8c1461f0 2024-04-13T02:45:36.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.889+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a8c0b4be0 con 0x7f8a8c1461f0 2024-04-13T02:45:36.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.889+0000 7f8a88ff9640 1 -- 172.21.15.114:0/2643052493 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f8a84058e70 con 0x7f8a8c1461f0 2024-04-13T02:45:36.890 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:36.890 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:29.798058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:36.891 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-13T02:45:36.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a7806c8f0 msgr2=0x7f8a7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a7806c8f0 0x7f8a7806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c006fd0 tx=0x7f8a7c008040 comp rx=0 tx=0).stop 2024-04-13T02:45:36.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 msgr2=0x7f8a8c13d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:36.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 0x7f8a8c13d110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c7a0 tx=0x7f8a8400cc60 comp rx=0 tx=0).stop 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 shutdown_connections 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a8c1461f0 0x7f8a8c13d110 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a8c0cedf0 0x7f8a8c14ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a7806c8f0 0x7f8a7806edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 --2- 172.21.15.114:0/2643052493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a8c0b3e10 0x7f8a8c1436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.891+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 >> 172.21.15.114:0/2643052493 conn(0x7f8a8c0b27b0 msgr2=0x7f8a8c15df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.892+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 shutdown_connections 2024-04-13T02:45:36.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:36.892+0000 7f8a922c8640 1 -- 172.21.15.114:0/2643052493 wait complete. 2024-04-13T02:45:37.306 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-13T02:45:27.799553+0000', 'modified': '2024-04-13T02:45:29.798058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5082': {'gid': 5082, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/2419206521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 2419206521}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 2419206521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5082, 'qdb_cluster': [5082]} 2024-04-13T02:45:37.306 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-13T02:45:37.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-13T02:45:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.408+0000 7fab181a3640 1 Processor -- start 2024-04-13T02:45:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.408+0000 7fab181a3640 1 -- start start 2024-04-13T02:45:37.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab181a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7fab1015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab181a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fab1015c130 0x7fab1006f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab181a3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab100cfd50 con 0x7fab100afff0 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab181a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fab100b3f30 con 0x7fab1015c130 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab181a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fab100b4210 con 0x7fab100cf690 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab15f3f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fab100afff0 0x7fab10144e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44954/0 (socket says 172.21.15.114:44954) 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab15f3f640 1 -- 172.21.15.114:0/835309398 learned_addr learned my addr 172.21.15.114:0/835309398 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab16740640 1 --2- 172.21.15.114:0/835309398 >> v2:172.21.15.130:3300/0 conn(0x7fab1015c130 0x7fab1006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab1573e640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7fab1015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776767403 0 0) 0x7fab100cfd50 con 0x7fab100afff0 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faafc003520 con 0x7fab100afff0 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734552937 0 0) 0x7faafc003520 con 0x7fab100afff0 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 msgr2=0x7fab1015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7fab1015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 >> v2:172.21.15.130:3300/0 conn(0x7fab1015c130 msgr2=0x7fab1006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 --2- 172.21.15.114:0/835309398 >> v2:172.21.15.130:3300/0 conn(0x7fab1015c130 0x7fab1006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab100d0030 con 0x7fab100afff0 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fab0c001670 con 0x7fab100afff0 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 >> v1:172.21.15.114:6789/0 conn(0x7fab100afff0 legacy=0x7fab10144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7faafc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faafc004d40 0x7faafc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab100b3f30 con 0x7faafc0039b0 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fab100b4210 con 0x7faafc004d40 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faafc00b9c0 con 0x7fab100cf690 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.409+0000 7fab15f3f640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab16740640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faafc004d40 0x7faafc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab1573e640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7faafc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab15f3f640 1 -- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 msgr2=0x7faafc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab15f3f640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7faafc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab15f3f640 1 -- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faafc004d40 msgr2=0x7faafc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab15f3f640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faafc004d40 0x7faafc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab15f3f640 1 -- 172.21.15.114:0/835309398 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc003520 con 0x7faafc0039b0 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab16740640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faafc004d40 0x7faafc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab1573e640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fab100cf690 0x7faafc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.410+0000 7fab15f3f640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fab0c007fd0 tx=0x7faafc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7370abbc8674d8a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c007d50 con 0x7faafc0039b0 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c030070 con 0x7faafc0039b0 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab14f3d640 1 -- 172.21.15.114:0/835309398 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c02cd40 con 0x7faafc0039b0 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab181a3640 1 -- 172.21.15.114:0/835309398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc0039b0 msgr2=0x7faafc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab181a3640 1 --2- 172.21.15.114:0/835309398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc0039b0 0x7faafc003dd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fab0c007fd0 tx=0x7faafc005830 comp rx=0 tx=0).stop 2024-04-13T02:45:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab16740640 1 -- 172.21.15.114:0/835309398 reap_dead start 2024-04-13T02:45:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab181a3640 1 -- 172.21.15.114:0/835309398 shutdown_connections 2024-04-13T02:45:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab181a3640 1 -- 172.21.15.114:0/835309398 >> 172.21.15.114:0/835309398 conn(0x7fab100b2460 msgr2=0x7fab100b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab181a3640 1 -- 172.21.15.114:0/835309398 shutdown_connections 2024-04-13T02:45:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.411+0000 7fab181a3640 1 -- 172.21.15.114:0/835309398 wait complete. 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.412+0000 7fab181a3640 1 Processor -- start 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.412+0000 7fab181a3640 1 -- start start 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab181a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faafc0039b0 0x7fab10139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab181a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab10142df0 0x7fab10139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab181a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 0x7fab101f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab181a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab1015bbf0 con 0x7fab10137b90 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab181a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fab100cfaf0 con 0x7fab10142df0 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab181a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fab1015bd70 con 0x7faafc0039b0 2024-04-13T02:45:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab16740640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 0x7fab101f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab16740640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 0x7fab101f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43306/0 (socket says 172.21.15.114:43306) 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab16740640 1 -- 172.21.15.114:0/2164408719 learned_addr learned my addr 172.21.15.114:0/2164408719 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faafc0039b0 0x7fab10139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab1573e640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab10142df0 0x7fab10139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.413+0000 7fab16740640 1 -- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faafc0039b0 msgr2=0x7fab10139130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab16740640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faafc0039b0 0x7fab10139130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab16740640 1 -- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab10142df0 msgr2=0x7fab10139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab16740640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab10142df0 0x7fab10139670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab16740640 1 -- 172.21.15.114:0/2164408719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab10138090 con 0x7fab10137b90 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab1573e640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab10142df0 0x7fab10139670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faafc0039b0 0x7fab10139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab16740640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 0x7fab101f2250 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fab1015c510 tx=0x7fab08010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab067fc640 1 -- 172.21.15.114:0/2164408719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0801a030 con 0x7fab10137b90 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab067fc640 1 -- 172.21.15.114:0/2164408719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab08010d20 con 0x7fab10137b90 2024-04-13T02:45:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab067fc640 1 -- 172.21.15.114:0/2164408719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08003bd0 con 0x7fab10137b90 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab10138370 con 0x7fab10137b90 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.414+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab10138930 con 0x7fab10137b90 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.415+0000 7fab067fc640 1 -- 172.21.15.114:0/2164408719 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab0801d070 con 0x7fab10137b90 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.416+0000 7fab067fc640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faaf406c920 0x7faaf406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.416+0000 7fab067fc640 1 -- 172.21.15.114:0/2164408719 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fab0808c020 con 0x7fab10137b90 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.416+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faaf406c920 0x7faaf406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.416+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faaf406c920 0x7faaf406ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab0c034000 tx=0x7fab0c039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 Processor -- start 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 -- start start 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae6fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9d1c0 0x55a00ae9fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae702c0 0x55a00aea00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a00adda990 con 0x55a00ae9cde0 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a00ad81620 con 0x55a00ae702c0 2024-04-13T02:45:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.417+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55a00add6950 con 0x55a00ae9d1c0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae6fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae6fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43312/0 (socket says 172.21.15.114:43312) 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 -- 172.21.15.114:0/2041965011 learned_addr learned my addr 172.21.15.114:0/2041965011 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab1573e640 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9d1c0 0x55a00ae9fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab16740640 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae702c0 0x55a00aea00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 -- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9d1c0 msgr2=0x55a00ae9fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9d1c0 0x55a00ae9fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 -- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae702c0 msgr2=0x55a00aea00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae702c0 0x55a00aea00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 -- 172.21.15.114:0/2041965011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a00aaed2d0 con 0x55a00ae9cde0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7fab15f3f640 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae6fd80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fab0c001e00 tx=0x7fab0c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2607a760e8ddaf59 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7faaf37fe640 1 -- 172.21.15.114:0/2041965011 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c050070 con 0x55a00ae9cde0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7faaf37fe640 1 -- 172.21.15.114:0/2041965011 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c030040 con 0x55a00ae9cde0 2024-04-13T02:45:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.418+0000 7faaf37fe640 1 -- 172.21.15.114:0/2041965011 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c007270 con 0x55a00ae9cde0 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 -- 172.21.15.114:0/2041965011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 msgr2=0x55a00ae6fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae6fd80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fab0c001e00 tx=0x7fab0c02e000 comp rx=0 tx=0).stop 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 -- 172.21.15.114:0/2041965011 shutdown_connections 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae702c0 0x55a00aea00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9d1c0 0x55a00ae9fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 --2- 172.21.15.114:0/2041965011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae6fd80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 -- 172.21.15.114:0/2041965011 >> 172.21.15.114:0/2041965011 conn(0x55a00ae71ff0 msgr2=0x55a00aebab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 -- 172.21.15.114:0/2041965011 shutdown_connections 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 -- 172.21.15.114:0/2041965011 wait complete. 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.419+0000 7fab1af87740 1 -- start start 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 Processor -- start 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9cde0 0x55a00ae91560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 0x55a00aea3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae95950 0x55a00ae95db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a00ae74590 con 0x55a00ae9d1c0 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a00ad949e0 con 0x55a00ae95950 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.420+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55a00ae73980 con 0x55a00ae9cde0 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1af87740 10 client.0 _ll_register_callbacks cb 0x55a00add0220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 0x55a00aea3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 0x55a00aea3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43322/0 (socket says 172.21.15.114:43322) 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 -- 172.21.15.114:0/1532357873 learned_addr learned my addr 172.21.15.114:0/1532357873 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9cde0 0x55a00ae91560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab16740640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae95950 0x55a00ae95db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 -- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9cde0 msgr2=0x55a00ae91560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9cde0 0x55a00ae91560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 -- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae95950 msgr2=0x55a00ae95db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae95950 0x55a00ae95db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 -- 172.21.15.114:0/1532357873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a00abb76b0 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9cde0 0x55a00ae91560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab16740640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae95950 0x55a00ae95db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1573e640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 0x55a00aea3590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fab000146e0 tx=0x7fab00014ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f51b44cfce23918 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7faaf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1532357873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00012ab0 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1532357873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fab00012c50 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab0c030040 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1532357873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fab00028050 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1af87740 10 client.5304 fetch_fsmap learned FSMap version 13 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a00aea2890 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.421+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1532357873 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c030040 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1532357873 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7fab0002b020 con 0x55a00ae9d1c0 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab1af87740 10 client.5304 fetch_fsmap finished waiting for FSMap version 13 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab1af87740 10 client.5304 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-13T02:45:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab1af87740 20 client.5304 populate_metadata read hostname 'smithi114' 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab1af87740 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00ae982f0 0x55a00ae9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab1af87740 4 client.5304 mds_command: new command op to 5082 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 --> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a00ade83b0 con 0x55a00ae982f0 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00ae982f0 0x55a00ae9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7faaf0ff9640 10 client.5304 ms_handle_connect on v2:172.21.15.114:6835/2419206521 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.422+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00ae982f0 0x55a00ae9ece0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4bd09e2dab67924 server_cookie=b52cecae5c1c7cf9 in_seq=0 out_seq=0 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1532357873 <== mds.0 v2:172.21.15.114:6835/2419206521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a00ade83b0 con 0x55a00ae982f0 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7faaf0ff9640 10 client.5304 handle_command_reply: tid=0 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 client.5304 shutdown 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 msgr2=0x55a00aea3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 0x55a00aea3590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fab000146e0 tx=0x7fab00014ba0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 shutdown_connections 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00ae982f0 0x55a00ae9ece0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae95950 0x55a00ae95db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9d1c0 0x55a00aea3590 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7faaf0ff9640 0 client.5304 ms_handle_reset on v2:172.21.15.114:6835/2419206521 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 --2- 172.21.15.114:0/1532357873 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae9cde0 0x55a00ae91560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 >> 172.21.15.114:0/1532357873 conn(0x55a00ae702c0 msgr2=0x55a00ae9b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 shutdown_connections 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 1 -- 172.21.15.114:0/1532357873 wait complete. 2024-04-13T02:45:37.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.423+0000 7fab1af87740 20 client.5304 trim_cache size 0 max 16384 2024-04-13T02:45:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.441+0000 7fab1af87740 1 Processor -- start 2024-04-13T02:45:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.441+0000 7fab1af87740 1 -- start start 2024-04-13T02:45:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00aebcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1af87740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae9ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1af87740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab101fe490 con 0x55a00ae9cde0 2024-04-13T02:45:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fab1015b2d0 con 0x55a00ae9d1c0 2024-04-13T02:45:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fab101fde40 con 0x55a00ae95950 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae9ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae9ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43324/0 (socket says 172.21.15.114:43324) 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 -- 172.21.15.114:0/74307807 learned_addr learned my addr 172.21.15.114:0/74307807 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 -- 172.21.15.114:0/74307807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 msgr2=0x55a00aebcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00aebcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 -- 172.21.15.114:0/74307807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 msgr2=0x55a00ae9f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 -- 172.21.15.114:0/74307807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a00ae6bd70 con 0x55a00ae9cde0 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.442+0000 7fab1573e640 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae9ec80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fab00013010 tx=0x7fab0001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178fb115d727cc2e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7faaf2ffd640 1 -- 172.21.15.114:0/74307807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab000128a0 con 0x55a00ae9cde0 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7faaf2ffd640 1 -- 172.21.15.114:0/74307807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab00012a40 con 0x55a00ae9cde0 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7faaf2ffd640 1 -- 172.21.15.114:0/74307807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00016660 con 0x55a00ae9cde0 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 -- 172.21.15.114:0/74307807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 msgr2=0x55a00ae9ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae9ec80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fab00013010 tx=0x7fab0001a000 comp rx=0 tx=0).stop 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 -- 172.21.15.114:0/74307807 shutdown_connections 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00ae9cde0 0x55a00ae9ec80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 --2- 172.21.15.114:0/74307807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00aebcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 -- 172.21.15.114:0/74307807 >> 172.21.15.114:0/74307807 conn(0x55a00ae702c0 msgr2=0x55a00ae91370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 -- 172.21.15.114:0/74307807 shutdown_connections 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.443+0000 7fab1af87740 1 -- 172.21.15.114:0/74307807 wait complete. 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.444+0000 7fab1af87740 1 -- start start 2024-04-13T02:45:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.444+0000 7fab1af87740 1 Processor -- start 2024-04-13T02:45:37.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00af38ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 0x55a00ae9f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a00ae98170 con 0x55a00aea0d90 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a00aea2bd0 con 0x55a00ae9d1c0 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55a00ae987c0 con 0x55a00ae95950 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 10 client.0 _ll_register_callbacks cb 0x7fab000094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 0x55a00ae9f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 0x55a00ae9f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43330/0 (socket says 172.21.15.114:43330) 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 -- 172.21.15.114:0/1346412468 learned_addr learned my addr 172.21.15.114:0/1346412468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00af38ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1573e640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 -- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 msgr2=0x55a00af38ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00af38ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 -- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 msgr2=0x55a00ae9ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 -- 172.21.15.114:0/1346412468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a00aea1240 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1573e640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab16740640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 0x55a00ae9f180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fab0808a600 tx=0x7fab0805a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa68253c0d2b3354 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7faaf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1346412468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08088060 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1346412468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fab0805a040 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab00012a40 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1346412468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fab0801d560 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 10 client.5310 fetch_fsmap learned FSMap version 13 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.445+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a00ae940a0 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1346412468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab00012a40 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1346412468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7fab08062530 con 0x55a00aea0d90 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 10 client.5310 fetch_fsmap finished waiting for FSMap version 13 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 10 client.5310 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 20 client.5310 populate_metadata read hostname 'smithi114' 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00aebdaa0 0x55a00aebde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 4 client.5310 mds_command: new command op to 5082 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 --> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] -- command(tid 0: {"prefix": "status"}) -- 0x55a00ade2220 con 0x55a00aebdaa0 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00aebdaa0 0x55a00aebde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7faaf0ff9640 10 client.5310 ms_handle_connect on v2:172.21.15.114:6835/2419206521 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab15f3f640 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00aebdaa0 0x55a00aebde80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e723ee82b3737873 server_cookie=ae9bbdb22b19abbf in_seq=0 out_seq=0 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7faaf0ff9640 1 -- 172.21.15.114:0/1346412468 <== mds.0 v2:172.21.15.114:6835/2419206521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a00ade2220 con 0x55a00aebdaa0 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7faaf0ff9640 10 client.5310 handle_command_reply: tid=0 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 client.5310 shutdown 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 msgr2=0x55a00ae9f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 0x55a00ae9f180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fab0808a600 tx=0x7fab0805a620 comp rx=0 tx=0).stop 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 shutdown_connections 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:6835/2419206521,v1:172.21.15.114:6837/2419206521] conn(0x55a00aebdaa0 0x55a00aebde80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a00aea0d90 0x55a00ae9f180 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7faaf0ff9640 0 client.5310 ms_handle_reset on v2:172.21.15.114:6835/2419206521 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a00ae9d1c0 0x55a00ae9ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 --2- 172.21.15.114:0/1346412468 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55a00ae95950 0x55a00af38ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.446+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 >> 172.21.15.114:0/1346412468 conn(0x55a00ae702c0 msgr2=0x55a00ae9d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 shutdown_connections 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab1af87740 1 -- 172.21.15.114:0/1346412468 wait complete. 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab1af87740 20 client.5310 trim_cache size 0 max 16384 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "202cca92-4b79-424a-b5f1-59b181ba42ec", 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5082, 2024-04-13T02:45:37.454 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 8.9958760180000006, 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 13, 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 31, 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 31, 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 15.887652982000001 2024-04-13T02:45:37.455 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faaf406c920 msgr2=0x7faaf406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faaf406c920 0x7faaf406ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab0c034000 tx=0x7fab0c039040 comp rx=0 tx=0).stop 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 msgr2=0x7fab101f2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 0x7fab101f2250 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fab1015c510 tx=0x7fab08010590 comp rx=0 tx=0).stop 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 shutdown_connections 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10137b90 0x7fab101f2250 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab10142df0 0x7fab10139670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7faaf406c920 0x7faaf406ede0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 --2- 172.21.15.114:0/2164408719 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faafc0039b0 0x7fab10139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 >> 172.21.15.114:0/2164408719 conn(0x7fab100b2460 msgr2=0x7fab1006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 shutdown_connections 2024-04-13T02:45:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.447+0000 7fab181a3640 1 -- 172.21.15.114:0/2164408719 wait complete. 2024-04-13T02:45:37.458 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-13T02:45:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 Processor -- start 2024-04-13T02:45:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 -- start start 2024-04-13T02:45:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f450c09ae00 0x7f450c09b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f450c0cedf0 0x7f450c160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f450c0c95e0 con 0x7f450c09b1e0 2024-04-13T02:45:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f450c160520 con 0x7f450c0cedf0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.560+0000 7f45130de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f450c0d0320 con 0x7f450c09ae00 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f450bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f450c0cedf0 0x7f450c160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f451167b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f450c09b1e0 0x7f450c0cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44966/0 (socket says 172.21.15.114:44966) 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f451167b640 1 -- 172.21.15.114:0/3501882412 learned_addr learned my addr 172.21.15.114:0/3501882412 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f4510e7a640 1 --2- 172.21.15.114:0/3501882412 >> v2:172.21.15.130:3300/0 conn(0x7f450c09ae00 0x7f450c09b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f450bfff640 1 -- 172.21.15.114:0/3501882412 >> v2:172.21.15.130:3300/0 conn(0x7f450c09ae00 msgr2=0x7f450c09b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f450bfff640 1 --2- 172.21.15.114:0/3501882412 >> v2:172.21.15.130:3300/0 conn(0x7f450c09ae00 0x7f450c09b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f450bfff640 1 -- 172.21.15.114:0/3501882412 >> v1:172.21.15.114:6789/0 conn(0x7f450c09b1e0 legacy=0x7f450c0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f450bfff640 1 -- 172.21.15.114:0/3501882412 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c0d05e0 con 0x7f450c0cedf0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.561+0000 7f450b7fe640 1 -- 172.21.15.114:0/3501882412 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963348484 0 0) 0x7f450c0c95e0 con 0x7f450c09b1e0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f450bfff640 1 --2- 172.21.15.114:0/3501882412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c160f70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f450c06c700 tx=0x7f44fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f72707126dab75 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f450b7fe640 1 -- 172.21.15.114:0/3501882412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0315a0 con 0x7f450c0cedf0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f450b7fe640 1 -- 172.21.15.114:0/3501882412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc037070 con 0x7f450c0cedf0 2024-04-13T02:45:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f450b7fe640 1 -- 172.21.15.114:0/3501882412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc031960 con 0x7f450c0cedf0 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 -- 172.21.15.114:0/3501882412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 msgr2=0x7f450c160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 --2- 172.21.15.114:0/3501882412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c160f70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f450c06c700 tx=0x7f44fc02b840 comp rx=0 tx=0).stop 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 -- 172.21.15.114:0/3501882412 shutdown_connections 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 --2- 172.21.15.114:0/3501882412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c160f70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 --2- 172.21.15.114:0/3501882412 >> v2:172.21.15.130:3300/0 conn(0x7f450c09ae00 0x7f450c09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 -- 172.21.15.114:0/3501882412 >> 172.21.15.114:0/3501882412 conn(0x7f450c0d2750 msgr2=0x7f450c0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 -- 172.21.15.114:0/3501882412 shutdown_connections 2024-04-13T02:45:37.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.562+0000 7f45130de640 1 -- 172.21.15.114:0/3501882412 wait complete. 2024-04-13T02:45:37.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 Processor -- start 2024-04-13T02:45:37.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 -- start start 2024-04-13T02:45:37.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f450c09ae00 0x7f450c06d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f450c09b1e0 0x7f450c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f450c15d900 con 0x7f450c0cedf0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f450c160770 con 0x7f450c09b1e0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.564+0000 7f45130de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f450c15da80 con 0x7f450c09ae00 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c15b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43336/0 (socket says 172.21.15.114:43336) 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 -- 172.21.15.114:0/1497159999 learned_addr learned my addr 172.21.15.114:0/1497159999 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f4510e7a640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f450c09ae00 0x7f450c06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f450bfff640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f450c09b1e0 0x7f450c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 -- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f450c09ae00 msgr2=0x7f450c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f450c09ae00 0x7f450c06d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 -- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f450c09b1e0 msgr2=0x7f450c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f450c09b1e0 0x7f450c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 -- 172.21.15.114:0/1497159999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c15a5d0 con 0x7f450c0cedf0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f450bfff640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f450c09b1e0 0x7f450c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f451167b640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c15b8d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f450400c7d0 tx=0x7f450400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504018070 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450400a640 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c15a8b0 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450400aa70 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.565+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c06e2b0 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.566+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c068c80 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.567+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f450401b070 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.567+0000 7f45097fa640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44ec06c8f0 0x7f44ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.567+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f450408b100 con 0x7f450c0cedf0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.567+0000 7f4510e7a640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44ec06c8f0 0x7f44ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.567+0000 7f4510e7a640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44ec06c8f0 0x7f44ec06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009b40 tx=0x7f44f4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.571+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4504058ee0 con 0x7f450c0cedf0 2024-04-13T02:45:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.786+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f450c0ccb60 con 0x7f450c0cedf0 2024-04-13T02:45:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.786+0000 7f45097fa640 1 -- 172.21.15.114:0/1497159999 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f450405d1e0 con 0x7f450c0cedf0 2024-04-13T02:45:37.787 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44ec06c8f0 msgr2=0x7f44ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44ec06c8f0 0x7f44ec06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009b40 tx=0x7f44f4009190 comp rx=0 tx=0).stop 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 msgr2=0x7f450c15b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c15b8d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f450400c7d0 tx=0x7f450400cc90 comp rx=0 tx=0).stop 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 shutdown_connections 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0cedf0 0x7f450c15b8d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f450c09b1e0 0x7f450c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f44ec06c8f0 0x7f44ec06edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 --2- 172.21.15.114:0/1497159999 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f450c09ae00 0x7f450c06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 >> 172.21.15.114:0/1497159999 conn(0x7f450c0d2750 msgr2=0x7f450c070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 shutdown_connections 2024-04-13T02:45:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:37.788+0000 7f45130de640 1 -- 172.21.15.114:0/1497159999 wait complete. 2024-04-13T02:45:37.799 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-13T02:45:37.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-13T02:45:37.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:37.800 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-13T02:45:37.815 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-13T02:45:37.815 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:45:37.816 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42700sec preferred_lft 42700sec 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:8b:3e:58:db:37 brd ff:ff:ff:ff:ff:ff 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::301c:13ff:fea6:db75/64 scope link 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 72:7f:c9:31:94:8c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::707f:c9ff:fe31:948c/64 scope link 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.817 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-13T02:45:37.818 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:8b:3e:58:db:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-13T02:45:37.818 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c8b:3eff:fe58:db37/64 scope link 2024-04-13T02:45:37.818 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-13T02:45:37.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:37.818 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-13T02:45:37.880 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-13T02:45:37.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:37.882 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-13T02:45:37.938 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-13T02:45:37.938 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-13T02:45:37.938 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-13T02:45:37.939 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-13T02:45:37.939 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-13T02:45:37.939 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-13T02:45:37.939 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-13T02:45:37.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-13T02:45:37.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-13T02:45:37.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-13T02:45:37.939 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-13T02:45:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-13T02:45:38.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:38.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.073 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:45:38.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-13T02:45:38.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-13T02:45:38.089 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-13T02:45:38.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.089 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-13T02:45:38.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:45:38.157 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-13T02:45:38.211 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-13T02:45:38.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-13T02:45:38.211 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-13T02:45:38.265 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-13T02:45:38.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:45:38.350 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:45:38.350 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-13T02:45:38.351 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:45:38.359 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:45:38.359 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-13T02:45:38.359 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:45:38.359 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:45:38.359 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-13T02:45:38.364 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=202cca92-4b79-424a-b5f1-59b181ba42ec" will pass to kernel 2024-04-13T02:45:38.365 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-13T02:45:38.365 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-04-13T02:45:38.365 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-13T02:45:38.365 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-04-13T02:45:38.365 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-13T02:45:38.366 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-13T02:45:38.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-13T02:45:38.393 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-13T02:45:38.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-13T02:45:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:38.493 INFO:teuthology.orchestra.run.smithi114.stdout:client4754 2024-04-13T02:45:38.493 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:38.494 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:38.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery false 2024-04-13T02:45:38.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 Processor -- start 2024-04-13T02:45:38.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 -- start start 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa46015ecc0 0x7fa4600d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa4600d3270 0x7fa4600b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4600ba4d0 con 0x7fa4600b3720 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa46015f0a0 con 0x7fa4600d3270 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa4655c8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa4600ba280 con 0x7fa46015ecc0 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa45e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa4600d3270 0x7fa4600b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.654+0000 7fa45f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa4600b3720 0x7fa4600cf6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52370/0 (socket says 172.21.15.114:52370) 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45f7fe640 1 -- 172.21.15.114:0/3685032094 learned_addr learned my addr 172.21.15.114:0/3685032094 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45effd640 1 --2- 172.21.15.114:0/3685032094 >> v2:172.21.15.130:3300/0 conn(0x7fa46015ecc0 0x7fa4600d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45e7fc640 1 -- 172.21.15.114:0/3685032094 >> v2:172.21.15.130:3300/0 conn(0x7fa46015ecc0 msgr2=0x7fa4600d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45e7fc640 1 --2- 172.21.15.114:0/3685032094 >> v2:172.21.15.130:3300/0 conn(0x7fa46015ecc0 0x7fa4600d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45e7fc640 1 -- 172.21.15.114:0/3685032094 >> v1:172.21.15.114:6789/0 conn(0x7fa4600b3720 legacy=0x7fa4600cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45dffb640 1 -- 172.21.15.114:0/3685032094 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442136064 0 0) 0x7fa4600ba4d0 con 0x7fa4600b3720 2024-04-13T02:45:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.655+0000 7fa45e7fc640 1 -- 172.21.15.114:0/3685032094 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4600ba7b0 con 0x7fa4600d3270 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa45e7fc640 1 --2- 172.21.15.114:0/3685032094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600d3270 0x7fa4600b95f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa4600cf1b0 tx=0x7fa45402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eef3d85ddb00b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa45dffb640 1 -- 172.21.15.114:0/3685032094 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454035020 con 0x7fa4600d3270 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa45dffb640 1 -- 172.21.15.114:0/3685032094 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa454031830 con 0x7fa4600d3270 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa45dffb640 1 -- 172.21.15.114:0/3685032094 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454031c00 con 0x7fa4600d3270 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 -- 172.21.15.114:0/3685032094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600d3270 msgr2=0x7fa4600b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 --2- 172.21.15.114:0/3685032094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600d3270 0x7fa4600b95f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa4600cf1b0 tx=0x7fa45402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 -- 172.21.15.114:0/3685032094 shutdown_connections 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 --2- 172.21.15.114:0/3685032094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600d3270 0x7fa4600b95f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 --2- 172.21.15.114:0/3685032094 >> v2:172.21.15.130:3300/0 conn(0x7fa46015ecc0 0x7fa4600d2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 -- 172.21.15.114:0/3685032094 >> 172.21.15.114:0/3685032094 conn(0x7fa460073480 msgr2=0x7fa460073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 -- 172.21.15.114:0/3685032094 shutdown_connections 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.656+0000 7fa4655c8640 1 -- 172.21.15.114:0/3685032094 wait complete. 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 Processor -- start 2024-04-13T02:45:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 -- start start 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4600b3720 0x7fa4600b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4600d3270 0x7fa46015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 0x7fa460153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4600b8aa0 con 0x7fa46015ecc0 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4600b90d0 con 0x7fa4600d3270 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa4655c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa4600cfdb0 con 0x7fa4600b3720 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.658+0000 7fa45f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 0x7fa460153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 0x7fa460153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37884/0 (socket says 172.21.15.114:37884) 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 -- 172.21.15.114:0/375159651 learned_addr learned my addr 172.21.15.114:0/375159651 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45e7fc640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4600d3270 0x7fa46015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 -- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4600b3720 msgr2=0x7fa4600b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4600b3720 0x7fa4600b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 -- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4600d3270 msgr2=0x7fa46015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4600d3270 0x7fa46015f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 -- 172.21.15.114:0/375159651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4600d46c0 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa45f7fe640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 0x7fa460153620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c450 tx=0x7fa45800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458018070 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa458007500 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4600d49a0 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458004a20 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.659+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4600b4660 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.660+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa460068c80 con 0x7fa46015ecc0 2024-04-13T02:45:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.661+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa45801b070 con 0x7fa46015ecc0 2024-04-13T02:45:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.661+0000 7fa4477fe640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa44c06c920 0x7fa44c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.661+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa45808ad80 con 0x7fa46015ecc0 2024-04-13T02:45:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.661+0000 7fa45effd640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa44c06c920 0x7fa44c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.661+0000 7fa45effd640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa44c06c920 0x7fa44c06ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4500070b0 tx=0x7fa450007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:38.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.665+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa458059240 con 0x7fa46015ecc0 2024-04-13T02:45:38.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.841+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7fa4600b4a00 con 0x7fa46015ecc0 2024-04-13T02:45:38.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.845+0000 7fa4477fe640 1 -- 172.21.15.114:0/375159651 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7fa458058b40 con 0x7fa46015ecc0 2024-04-13T02:45:38.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa44c06c920 msgr2=0x7fa44c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:38.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa44c06c920 0x7fa44c06ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4500070b0 tx=0x7fa450007040 comp rx=0 tx=0).stop 2024-04-13T02:45:38.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 msgr2=0x7fa460153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:38.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 0x7fa460153620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c450 tx=0x7fa45800c910 comp rx=0 tx=0).stop 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 shutdown_connections 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa46015ecc0 0x7fa460153620 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4600d3270 0x7fa46015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa44c06c920 0x7fa44c06ede0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 --2- 172.21.15.114:0/375159651 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4600b3720 0x7fa4600b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 >> 172.21.15.114:0/375159651 conn(0x7fa460073480 msgr2=0x7fa46015cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 shutdown_connections 2024-04-13T02:45:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:38.847+0000 7fa4655c8640 1 -- 172.21.15.114:0/375159651 wait complete. 2024-04-13T02:45:38.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.859 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir0) 2024-04-13T02:45:38.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.878 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir0/file1) 2024-04-13T02:45:38.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:38.935 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s sym_dir0/file1 sym_dir0/symlink_file1) 2024-04-13T02:45:38.990 DEBUG:teuthology.orchestra.run.smithi114:> stdin-killer -- python3 -c ' 2024-04-13T02:45:38.990 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-04-13T02:45:38.990 DEBUG:teuthology.orchestra.run.smithi114:> import stat 2024-04-13T02:45:38.990 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-13T02:45:38.991 DEBUG:teuthology.orchestra.run.smithi114:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir0/symlink_file1").st_ino) 2024-04-13T02:45:38.991 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-04-13T02:45:39.095 INFO:teuthology.orchestra.run.smithi114.stdout:1099511628278 2024-04-13T02:45:39.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:39.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:39.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 Processor -- start 2024-04-13T02:45:39.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 -- start start 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 0x7f6da00d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6da00d1a10 0x7f6da00b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da00d2d90 con 0x7f6da00d43c0 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f6da00d3070 con 0x7f6da00d1a10 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.245+0000 7f6da6fbb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6da00d3350 con 0x7f6da015eac0 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da5558640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6da00d1a10 0x7f6da00b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da4d57640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 0x7f6da00d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6d9ffff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f6da00d43c0 0x7f6da00d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:39032/0 (socket says 172.21.15.114:39032) 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da4d57640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 0x7f6da00d3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:40354/0 (socket says 172.21.15.114:40354) 2024-04-13T02:45:39.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da5558640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6da00d1a10 0x7f6da00b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:44342/0 (socket says 172.21.15.114:44342) 2024-04-13T02:45:39.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6d9ffff640 1 -- 172.21.15.114:0/746799947 learned_addr learned my addr 172.21.15.114:0/746799947 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:39.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da5558640 1 -- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 msgr2=0x7f6da00d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:39.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da5558640 1 --2- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 0x7f6da00d3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da5558640 1 -- 172.21.15.114:0/746799947 >> v1:172.21.15.130:6789/0 conn(0x7f6da00d43c0 legacy=0x7f6da00d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da5558640 1 -- 172.21.15.114:0/746799947 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da00d3630 con 0x7f6da00d1a10 2024-04-13T02:45:39.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.246+0000 7f6da4d57640 1 --2- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 0x7f6da00d3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:39.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.247+0000 7f6da5558640 1 --2- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d1a10 0x7f6da00b3470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6d900097a0 tx=0x7f6d9002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6539a96bc5195c server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.247+0000 7f6d9f7fe640 1 -- 172.21.15.114:0/746799947 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90035020 con 0x7f6da00d1a10 2024-04-13T02:45:39.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.247+0000 7f6d9f7fe640 1 -- 172.21.15.114:0/746799947 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d90031830 con 0x7f6da00d1a10 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.247+0000 7f6d9f7fe640 1 -- 172.21.15.114:0/746799947 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90031c00 con 0x7f6da00d1a10 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 -- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d1a10 msgr2=0x7f6da00b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d1a10 0x7f6da00b3470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6d900097a0 tx=0x7f6d9002b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 -- 172.21.15.114:0/746799947 shutdown_connections 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d1a10 0x7f6da00b3470 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/746799947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da015eac0 0x7f6da00d3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 -- 172.21.15.114:0/746799947 >> 172.21.15.114:0/746799947 conn(0x7f6da0073690 msgr2=0x7f6da006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 -- 172.21.15.114:0/746799947 shutdown_connections 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.248+0000 7f6da6fbb640 1 -- 172.21.15.114:0/746799947 wait complete. 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.249+0000 7f6da6fbb640 1 Processor -- start 2024-04-13T02:45:39.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.249+0000 7f6da6fbb640 1 -- start start 2024-04-13T02:45:39.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da6fbb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da00d1a10 0x7f6da00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da6fbb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d43c0 0x7f6da00cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da6fbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 0x7f6da00cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da6fbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6da00d29f0 con 0x7f6da015eac0 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da6fbb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6da015eea0 con 0x7f6da00d43c0 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da6fbb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6da00d2b70 con 0x7f6da00d1a10 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 0x7f6da00cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 0x7f6da00cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37898/0 (socket says 172.21.15.114:37898) 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 -- 172.21.15.114:0/3748002253 learned_addr learned my addr 172.21.15.114:0/3748002253 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6d9ffff640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d43c0 0x7f6da00cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da4d57640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da00d1a10 0x7f6da00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 -- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da00d1a10 msgr2=0x7f6da00b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da00d1a10 0x7f6da00b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 -- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d43c0 msgr2=0x7f6da00cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d43c0 0x7f6da00cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 -- 172.21.15.114:0/3748002253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da00ab520 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6d9ffff640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d43c0 0x7f6da00cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6da5558640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 0x7f6da00cdff0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6d9002bee0 tx=0x7f6d900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.250+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90035040 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.251+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9003f070 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.251+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da00ab800 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.251+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9003ba80 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.251+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da00abdc0 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.252+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da0068c80 con 0x7f6da015eac0 2024-04-13T02:45:39.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.252+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d90038020 con 0x7f6da015eac0 2024-04-13T02:45:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.252+0000 7f6d9d7fa640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6d8006c8f0 0x7f6d8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.252+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6d900ad9a0 con 0x7f6da015eac0 2024-04-13T02:45:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.252+0000 7f6da4d57640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6d8006c8f0 0x7f6d8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.253+0000 7f6da4d57640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6d8006c8f0 0x7f6d8006edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6d98007440 tx=0x7f6d9800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.257+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d90031800 con 0x7f6da015eac0 2024-04-13T02:45:39.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.468+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6da00abf90 con 0x7f6da015eac0 2024-04-13T02:45:39.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.468+0000 7f6d9d7fa640 1 -- 172.21.15.114:0/3748002253 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f6d9007bde0 con 0x7f6da015eac0 2024-04-13T02:45:39.469 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:39.469 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:29.798058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:39.470 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-13T02:45:39.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6d8006c8f0 msgr2=0x7f6d8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6d8006c8f0 0x7f6d8006edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6d98007440 tx=0x7f6d9800b040 comp rx=0 tx=0).stop 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 msgr2=0x7f6da00cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 0x7f6da00cdff0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6d9002bee0 tx=0x7f6d900046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 shutdown_connections 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da015eac0 0x7f6da00cdff0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da00d43c0 0x7f6da00cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6d8006c8f0 0x7f6d8006edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 --2- 172.21.15.114:0/3748002253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6da00d1a10 0x7f6da00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 >> 172.21.15.114:0/3748002253 conn(0x7f6da0073690 msgr2=0x7f6da00cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.470+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 shutdown_connections 2024-04-13T02:45:39.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.471+0000 7f6da6fbb640 1 -- 172.21.15.114:0/3748002253 wait complete. 2024-04-13T02:45:39.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-13T02:45:39.611 INFO:teuthology.orchestra.run.smithi114.stdout:{"message":"","return_code":0} 2024-04-13T02:45:39.611 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-13T02:45:39.611 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink 2024-04-13T02:45:39.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 Processor -- start 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 -- start start 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e2c6140 0x56416e1f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e359560 0x56416e2bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 0x56416e2c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56416e19ed00 con 0x56416e1f9510 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56416e1a2d40 con 0x56416e359560 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feabbe92f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x56416e240ce0 con 0x56416e2c6140 2024-04-13T02:45:39.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feab9f50640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 0x56416e2c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feab9f50640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 0x56416e2c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37910/0 (socket says 172.21.15.114:37910) 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feab9f50640 1 -- 172.21.15.114:0/339816970 learned_addr learned my addr 172.21.15.114:0/339816970 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feab974f640 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e2c6140 0x56416e1f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.654+0000 7feab8f4e640 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e359560 0x56416e2bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab9f50640 1 -- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e2c6140 msgr2=0x56416e1f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab9f50640 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e2c6140 0x56416e1f8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab9f50640 1 -- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e359560 msgr2=0x56416e2bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab9f50640 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e359560 0x56416e2bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab9f50640 1 -- 172.21.15.114:0/339816970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56416e2c40c0 con 0x56416e1f9510 2024-04-13T02:45:39.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab974f640 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e2c6140 0x56416e1f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feab9f50640 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 0x56416e2c7330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feab40448c0 tx=0x7feab4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66e3583e1417099 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feaab7fe640 1 -- 172.21.15.114:0/339816970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4061070 con 0x56416e1f9510 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feaab7fe640 1 -- 172.21.15.114:0/339816970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab40527f0 con 0x56416e1f9510 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feaab7fe640 1 -- 172.21.15.114:0/339816970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4057040 con 0x56416e1f9510 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feabbe92f40 1 -- 172.21.15.114:0/339816970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 msgr2=0x56416e2c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.655+0000 7feabbe92f40 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 0x56416e2c7330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feab40448c0 tx=0x7feab4002fb0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 -- 172.21.15.114:0/339816970 shutdown_connections 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f9510 0x56416e2c7330 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e359560 0x56416e2bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 --2- 172.21.15.114:0/339816970 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e2c6140 0x56416e1f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 -- 172.21.15.114:0/339816970 >> 172.21.15.114:0/339816970 conn(0x56416e222a20 msgr2=0x56416e1f6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 -- 172.21.15.114:0/339816970 shutdown_connections 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 -- 172.21.15.114:0/339816970 wait complete. 2024-04-13T02:45:39.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 Processor -- start 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.656+0000 7feabbe92f40 1 -- start start 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feabbe92f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e1f9510 0x56416e2c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feabbe92f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e2c6140 0x56416e2bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feabbe92f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f6960 0x56416e2c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feabbe92f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56416e1f8bc0 con 0x56416e1f6960 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feabbe92f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56416e241230 con 0x56416e2c6140 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feabbe92f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x56416e2c3d70 con 0x56416e1f9510 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f6960 0x56416e2c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f6960 0x56416e2c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37914/0 (socket says 172.21.15.114:37914) 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 -- 172.21.15.114:0/3801282525 learned_addr learned my addr 172.21.15.114:0/3801282525 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab8f4e640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e2c6140 0x56416e2bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab974f640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e1f9510 0x56416e2c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 -- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e1f9510 msgr2=0x56416e2c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56416e1f9510 0x56416e2c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 -- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e2c6140 msgr2=0x56416e2bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56416e2c6140 0x56416e2bd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 -- 172.21.15.114:0/3801282525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56416e363810 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feab9f50640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f6960 0x56416e2c1fe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feab4054040 tx=0x7feab4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.657+0000 7feaaa7fc640 1 -- 172.21.15.114:0/3801282525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab406e070 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.658+0000 7feaaa7fc640 1 -- 172.21.15.114:0/3801282525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab40529a0 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.658+0000 7feaaa7fc640 1 -- 172.21.15.114:0/3801282525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4061040 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.658+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56416e363af0 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.658+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416e2c7830 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.659+0000 7feaaa7fc640 1 -- 172.21.15.114:0/3801282525 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feab4071070 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.659+0000 7feaaa7fc640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fea9c06b2d0 0x7fea9c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.659+0000 7feaaa7fc640 1 -- 172.21.15.114:0/3801282525 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7feab40ccc70 con 0x56416e1f6960 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.659+0000 7feab974f640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fea9c06b2d0 0x7fea9c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.659+0000 7feabbe92f40 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x56416e364c10 0x56416e365020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.659+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 --> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] -- osd_op(unknown.0.0:1 5.2a 5:57fe7535:::100000001f6.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56416e365560 con 0x56416e364c10 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feab974f640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fea9c06b2d0 0x7fea9c06d790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feaac0034b0 tx=0x7feaac005040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feab8f4e640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x56416e364c10 0x56416e365020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feab8f4e640 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x56416e364c10 0x56416e365020 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feab8f4e640 1 -- 172.21.15.114:0/3801282525 <== osd.4 v2:172.21.15.130:6800/3673343722 1 ==== osd_op_reply(1 100000001f6.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7feab0011420 con 0x56416e364c10 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:error getting xattr cephfs_data/100000001f6.00000000/symlink: (61) No data available 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x56416e364c10 msgr2=0x56416e365020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feabbe92f40 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x56416e364c10 0x56416e365020 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fea9c06b2d0 msgr2=0x7fea9c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feabbe92f40 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fea9c06b2d0 0x7fea9c06d790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feaac0034b0 tx=0x7feaac005040 comp rx=0 tx=0).stop 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f6960 msgr2=0x56416e2c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.660+0000 7feabbe92f40 1 --2- 172.21.15.114:0/3801282525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56416e1f6960 0x56416e2c1fe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feab4054040 tx=0x7feab4005a00 comp rx=0 tx=0).stop 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.661+0000 7feab9f50640 1 -- 172.21.15.114:0/3801282525 reap_dead start 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.661+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 shutdown_connections 2024-04-13T02:45:39.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.661+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 >> 172.21.15.114:0/3801282525 conn(0x56416e222a20 msgr2=0x56416e2274f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:39.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.661+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 shutdown_connections 2024-04-13T02:45:39.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.661+0000 7feabbe92f40 1 -- 172.21.15.114:0/3801282525 wait complete. 2024-04-13T02:45:39.670 ERROR:tasks.cephfs.filesystem:Command failed on smithi114 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink' 2024-04-13T02:45:39.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery true 2024-04-13T02:45:39.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 Processor -- start 2024-04-13T02:45:39.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 -- start start 2024-04-13T02:45:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3720 0x7ff76c0b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff76c0b3c70 0x7ff76c0b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76c0ba4d0 con 0x7ff76c15ecc0 2024-04-13T02:45:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff76c15f0a0 con 0x7ff76c0b3c70 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.808+0000 7ff7714de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c0ba280 con 0x7ff76c0b3720 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff76c0b3c70 0x7ff76c0b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff76c0b3c70 0x7ff76c0b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37926/0 (socket says 172.21.15.114:37926) 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 -- 172.21.15.114:0/1494266775 learned_addr learned my addr 172.21.15.114:0/1494266775 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff763fff640 1 --2- 172.21.15.114:0/1494266775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3720 0x7ff76c0b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 -- 172.21.15.114:0/1494266775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3720 msgr2=0x7ff76c0b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 --2- 172.21.15.114:0/1494266775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3720 0x7ff76c0b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 -- 172.21.15.114:0/1494266775 >> v1:172.21.15.130:6789/0 conn(0x7ff76c15ecc0 legacy=0x7ff76c0d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.809+0000 7ff76b7fe640 1 -- 172.21.15.114:0/1494266775 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c0ba7b0 con 0x7ff76c0b3c70 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff76b7fe640 1 --2- 172.21.15.114:0/1494266775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c0b3c70 0x7ff76c0b9b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff764009e50 tx=0x7ff76402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874e583433ca715d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff76a7fc640 1 -- 172.21.15.114:0/1494266775 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76402cb00 con 0x7ff76c0b3c70 2024-04-13T02:45:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff76a7fc640 1 -- 172.21.15.114:0/1494266775 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76402cca0 con 0x7ff76c0b3c70 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff76a7fc640 1 -- 172.21.15.114:0/1494266775 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764034610 con 0x7ff76c0b3c70 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 -- 172.21.15.114:0/1494266775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c0b3c70 msgr2=0x7ff76c0b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 --2- 172.21.15.114:0/1494266775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c0b3c70 0x7ff76c0b9b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff764009e50 tx=0x7ff76402bf60 comp rx=0 tx=0).stop 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 -- 172.21.15.114:0/1494266775 shutdown_connections 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 --2- 172.21.15.114:0/1494266775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3720 0x7ff76c0b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 --2- 172.21.15.114:0/1494266775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c0b3c70 0x7ff76c0b9b30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 -- 172.21.15.114:0/1494266775 >> 172.21.15.114:0/1494266775 conn(0x7ff76c073480 msgr2=0x7ff76c073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 -- 172.21.15.114:0/1494266775 shutdown_connections 2024-04-13T02:45:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.810+0000 7ff7714de640 1 -- 172.21.15.114:0/1494266775 wait complete. 2024-04-13T02:45:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 Processor -- start 2024-04-13T02:45:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 -- start start 2024-04-13T02:45:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff76c0b3720 0x7ff76c0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3c70 0x7ff76c161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 0x7ff76c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c0b8aa0 con 0x7ff76c15ecc0 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c0b90d0 con 0x7ff76c0b3720 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff7714de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c0d3440 con 0x7ff76c0b3c70 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 0x7ff76c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 0x7ff76c15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37936/0 (socket says 172.21.15.114:37936) 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.812+0000 7ff76b7fe640 1 -- 172.21.15.114:0/3131025957 learned_addr learned my addr 172.21.15.114:0/3131025957 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76affd640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff76c0b3720 0x7ff76c0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76b7fe640 1 -- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3c70 msgr2=0x7ff76c161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff763fff640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3c70 0x7ff76c161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76b7fe640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3c70 0x7ff76c161710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76b7fe640 1 -- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff76c0b3720 msgr2=0x7ff76c0b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76b7fe640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff76c0b3720 0x7ff76c0b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76b7fe640 1 -- 172.21.15.114:0/3131025957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c0b5490 con 0x7ff76c15ecc0 2024-04-13T02:45:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76affd640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff76c0b3720 0x7ff76c0b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff76b7fe640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 0x7ff76c15f450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff764036040 tx=0x7ff764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764043020 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76402ce50 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764009510 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c0b5770 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.813+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c153c10 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.814+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c068c80 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.815+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff764046020 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.815+0000 7ff7637fe640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff74c06c8f0 0x7ff74c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.815+0000 7ff76affd640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff74c06c8f0 0x7ff74c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.815+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff7640ae1d0 con 0x7ff76c15ecc0 2024-04-13T02:45:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.816+0000 7ff76affd640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff74c06c8f0 0x7ff74c06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff75c001680 tx=0x7ff75c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:39.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.819+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff76404d030 con 0x7ff76c15ecc0 2024-04-13T02:45:39.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.995+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7ff76c153de0 con 0x7ff76c15ecc0 2024-04-13T02:45:39.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:39.998+0000 7ff7637fe640 1 -- 172.21.15.114:0/3131025957 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7ff76407c600 con 0x7ff76c15ecc0 2024-04-13T02:45:40.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff74c06c8f0 msgr2=0x7ff74c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff74c06c8f0 0x7ff74c06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff75c001680 tx=0x7ff75c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 msgr2=0x7ff76c15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 0x7ff76c15f450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff764036040 tx=0x7ff764004a40 comp rx=0 tx=0).stop 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 shutdown_connections 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c15ecc0 0x7ff76c15f450 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff74c06c8f0 0x7ff74c06edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff76c0b3c70 0x7ff76c161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 --2- 172.21.15.114:0/3131025957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff76c0b3720 0x7ff76c0b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.000+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 >> 172.21.15.114:0/3131025957 conn(0x7ff76c073480 msgr2=0x7ff76c15d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.001+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 shutdown_connections 2024-04-13T02:45:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.001+0000 7ff7714de640 1 -- 172.21.15.114:0/3131025957 wait complete. 2024-04-13T02:45:40.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:40.012 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir) 2024-04-13T02:45:40.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:40.029 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir/file1) 2024-04-13T02:45:40.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:40.087 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s ./file1 sym_dir/symlink_file1) 2024-04-13T02:45:40.143 DEBUG:teuthology.orchestra.run.smithi114:> stdin-killer -- python3 -c ' 2024-04-13T02:45:40.144 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-04-13T02:45:40.144 DEBUG:teuthology.orchestra.run.smithi114:> import stat 2024-04-13T02:45:40.144 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-13T02:45:40.144 DEBUG:teuthology.orchestra.run.smithi114:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir/symlink_file1").st_ino) 2024-04-13T02:45:40.144 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-04-13T02:45:40.247 INFO:teuthology.orchestra.run.smithi114.stdout:1099511628281 2024-04-13T02:45:40.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:40.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.395+0000 7fe2478de640 1 Processor -- start 2024-04-13T02:45:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.396+0000 7fe2478de640 1 -- start start 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.396+0000 7fe2478de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe2400d1300 0x7fe2400d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.396+0000 7fe2478de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2400d2d90 con 0x7fe2400b3470 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.396+0000 7fe2478de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2400d3070 con 0x7fe24015eac0 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.396+0000 7fe2478de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe2400d1cd0 con 0x7fe2400d1300 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe245e7b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe2400b3470 0x7fe2400b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52390/0 (socket says 172.21.15.114:52390) 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe245e7b640 1 -- 172.21.15.114:0/4081628718 learned_addr learned my addr 172.21.15.114:0/4081628718 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515637187 0 0) 0x7fe2400d2d90 con 0x7fe2400b3470 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe22c003520 con 0x7fe2400b3470 2024-04-13T02:45:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe244e79640 1 --2- 172.21.15.114:0/4081628718 >> v2:172.21.15.130:3300/0 conn(0x7fe2400d1300 0x7fe2400d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3364141551 0 0) 0x7fe22c003520 con 0x7fe2400b3470 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 >> v2:172.21.15.130:3300/0 conn(0x7fe2400d1300 msgr2=0x7fe2400d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 --2- 172.21.15.114:0/4081628718 >> v2:172.21.15.130:3300/0 conn(0x7fe2400d1300 0x7fe2400d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 >> v1:172.21.15.130:6789/0 conn(0x7fe24015eac0 legacy=0x7fe2400d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2400d3350 con 0x7fe2400b3470 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fe2380019f0 con 0x7fe2400b3470 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 >> v1:172.21.15.114:6789/0 conn(0x7fe2400b3470 legacy=0x7fe2400b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c0039b0 0x7fe22c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c004800 0x7fe22c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0051c0 0x7fe22c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400d1cd0 con 0x7fe22c0039b0 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c00c060 con 0x7fe22c0051c0 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c00c260 con 0x7fe22c004800 2024-04-13T02:45:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe24567a640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c0039b0 0x7fe22c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe245e7b640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0051c0 0x7fe22c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.397+0000 7fe244e79640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c004800 0x7fe22c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe24567a640 1 -- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c004800 msgr2=0x7fe22c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe24567a640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c004800 0x7fe22c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe24567a640 1 -- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0051c0 msgr2=0x7fe22c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe24567a640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0051c0 0x7fe22c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe245e7b640 1 -- 172.21.15.114:0/4081628718 reap_dead start 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe24567a640 1 -- 172.21.15.114:0/4081628718 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c003520 con 0x7fe22c0039b0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe24567a640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c0039b0 0x7fe22c003dd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe23c001750 tx=0x7fe22c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b94c5829a148568 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c001370 con 0x7fe22c0039b0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c0052d0 con 0x7fe22c0039b0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.398+0000 7fe237fff640 1 -- 172.21.15.114:0/4081628718 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c003830 con 0x7fe22c0039b0 2024-04-13T02:45:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 -- 172.21.15.114:0/4081628718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c0039b0 msgr2=0x7fe22c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c0039b0 0x7fe22c003dd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe23c001750 tx=0x7fe22c005830 comp rx=0 tx=0).stop 2024-04-13T02:45:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 -- 172.21.15.114:0/4081628718 shutdown_connections 2024-04-13T02:45:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 --2- 172.21.15.114:0/4081628718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c0039b0 0x7fe22c003dd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 -- 172.21.15.114:0/4081628718 >> 172.21.15.114:0/4081628718 conn(0x7fe240073690 msgr2=0x7fe24006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 -- 172.21.15.114:0/4081628718 shutdown_connections 2024-04-13T02:45:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.399+0000 7fe2478de640 1 -- 172.21.15.114:0/4081628718 wait complete. 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.400+0000 7fe2478de640 1 Processor -- start 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.400+0000 7fe2478de640 1 -- start start 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe2478de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c0039b0 0x7fe2401549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe2478de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe240153f70 0x7fe2401569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe2478de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 0x7fe240145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe2478de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe24015eea0 con 0x7fe240156ef0 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe2478de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2400d3910 con 0x7fe240153f70 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe2478de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe2400d29f0 con 0x7fe22c0039b0 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 0x7fe240145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 0x7fe240145850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37956/0 (socket says 172.21.15.114:37956) 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 -- 172.21.15.114:0/500861647 learned_addr learned my addr 172.21.15.114:0/500861647 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe24567a640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c0039b0 0x7fe2401549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe244e79640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe240153f70 0x7fe2401569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 -- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c0039b0 msgr2=0x7fe2401549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c0039b0 0x7fe2401549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 -- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe240153f70 msgr2=0x7fe2401569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe240153f70 0x7fe2401569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 -- 172.21.15.114:0/500861647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe240157550 con 0x7fe240156ef0 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe24567a640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c0039b0 0x7fe2401549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:40.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe244e79640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe240153f70 0x7fe2401569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:40.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.401+0000 7fe245e7b640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 0x7fe240145850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe2400cef40 tx=0x7fe238007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.402+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23800ab00 con 0x7fe240156ef0 2024-04-13T02:45:40.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.402+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe238018070 con 0x7fe240156ef0 2024-04-13T02:45:40.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.402+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2380133f0 con 0x7fe240156ef0 2024-04-13T02:45:40.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.402+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe240157830 con 0x7fe240156ef0 2024-04-13T02:45:40.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.402+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe240154f10 con 0x7fe240156ef0 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.403+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe240157d50 con 0x7fe240156ef0 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.403+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe238013590 con 0x7fe240156ef0 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.403+0000 7fe235ffb640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe22406c8f0 0x7fe22406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.404+0000 7fe24567a640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe22406c8f0 0x7fe22406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.404+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe23808c090 con 0x7fe240156ef0 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.404+0000 7fe24567a640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe22406c8f0 0x7fe22406edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe23c033000 tx=0x7fe23c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.408+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe240157d50 con 0x7fe240156ef0 2024-04-13T02:45:40.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.620+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe240068c80 con 0x7fe240156ef0 2024-04-13T02:45:40.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.621+0000 7fe235ffb640 1 -- 172.21.15.114:0/500861647 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7fe23805a4c0 con 0x7fe240156ef0 2024-04-13T02:45:40.622 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:40.622 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:29.798058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:40.622 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe22406c8f0 msgr2=0x7fe22406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe22406c8f0 0x7fe22406edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe23c033000 tx=0x7fe23c009030 comp rx=0 tx=0).stop 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 msgr2=0x7fe240145850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 0x7fe240145850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe2400cef40 tx=0x7fe238007a90 comp rx=0 tx=0).stop 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 shutdown_connections 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe240156ef0 0x7fe240145850 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe240153f70 0x7fe2401569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe22406c8f0 0x7fe22406edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 --2- 172.21.15.114:0/500861647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c0039b0 0x7fe2401549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 >> 172.21.15.114:0/500861647 conn(0x7fe240073690 msgr2=0x7fe2400d3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 shutdown_connections 2024-04-13T02:45:40.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.623+0000 7fe2478de640 1 -- 172.21.15.114:0/500861647 wait complete. 2024-04-13T02:45:40.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-13T02:45:40.762 INFO:teuthology.orchestra.run.smithi114.stdout:{"message":"","return_code":0} 2024-04-13T02:45:40.762 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-13T02:45:40.762 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f9.00000000 symlink 2024-04-13T02:45:40.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.803+0000 7f1f1143ff40 1 Processor -- start 2024-04-13T02:45:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.803+0000 7f1f1143ff40 1 -- start start 2024-04-13T02:45:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f1143ff40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x55862540f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f1143ff40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x55862549f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f1143ff40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x55862549f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f1143ff40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558625365fd0 con 0x55862537fa80 2024-04-13T02:45:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f1143ff40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5586252dfd00 con 0x55862540c450 2024-04-13T02:45:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f1143ff40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x558625366270 con 0x55862540c830 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x55862540f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x55862540f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37966/0 (socket says 172.21.15.114:37966) 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 -- 172.21.15.114:0/2600735695 learned_addr learned my addr 172.21.15.114:0/2600735695 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0dc4a640 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x55862549f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0ec4c640 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x55862549f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 -- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 msgr2=0x55862549f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x55862549f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 -- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 msgr2=0x55862549f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x55862549f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 -- 172.21.15.114:0/2600735695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558625368230 con 0x55862537fa80 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0e44b640 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x55862540f390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000a490 tx=0x7f1f0000a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501cc1c25f77e27f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0cc48640 1 -- 172.21.15.114:0/2600735695 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000f7b0 con 0x55862537fa80 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0cc48640 1 -- 172.21.15.114:0/2600735695 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f00015070 con 0x55862537fa80 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.804+0000 7f1f0cc48640 1 -- 172.21.15.114:0/2600735695 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000fbb0 con 0x55862537fa80 2024-04-13T02:45:40.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 -- 172.21.15.114:0/2600735695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 msgr2=0x55862540f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x55862540f390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000a490 tx=0x7f1f0000a950 comp rx=0 tx=0).stop 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 -- 172.21.15.114:0/2600735695 shutdown_connections 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x55862549f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x55862549f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/2600735695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x55862540f390 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 -- 172.21.15.114:0/2600735695 >> 172.21.15.114:0/2600735695 conn(0x558625363a20 msgr2=0x55862540ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 -- 172.21.15.114:0/2600735695 shutdown_connections 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 -- 172.21.15.114:0/2600735695 wait complete. 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 Processor -- start 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.805+0000 7f1f1143ff40 1 -- start start 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f1143ff40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x558625409d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f1143ff40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x5586253f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f1143ff40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x5586253f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f1143ff40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x558625338ce0 con 0x55862537fa80 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f1143ff40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5586253684d0 con 0x55862540c450 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f1143ff40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55862540b6f0 con 0x55862540c830 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0e44b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x558625409d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0e44b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x558625409d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37968/0 (socket says 172.21.15.114:37968) 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0e44b640 1 -- 172.21.15.114:0/1068980211 learned_addr learned my addr 172.21.15.114:0/1068980211 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0dc4a640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x5586253f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0ec4c640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x5586253f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0e44b640 1 -- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 msgr2=0x5586253f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.806+0000 7f1f0e44b640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x5586253f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f0e44b640 1 -- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 msgr2=0x5586253f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f0e44b640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55862540c450 0x5586253f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f0e44b640 1 -- 172.21.15.114:0/1068980211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55862540a8d0 con 0x55862537fa80 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f0ec4c640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55862540c830 0x5586253f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f0e44b640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x558625409d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x558625339490 tx=0x7f1f000032f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f077fe640 1 -- 172.21.15.114:0/1068980211 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00025650 con 0x55862537fa80 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f077fe640 1 -- 172.21.15.114:0/1068980211 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f00025810 con 0x55862537fa80 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55862540a5f0 con 0x55862537fa80 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f077fe640 1 -- 172.21.15.114:0/1068980211 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00025c00 con 0x55862537fa80 2024-04-13T02:45:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.807+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558625407f10 con 0x55862537fa80 2024-04-13T02:45:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.808+0000 7f1f077fe640 1 -- 172.21.15.114:0/1068980211 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f00010440 con 0x55862537fa80 2024-04-13T02:45:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f077fe640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ef006b2d0 0x7f1ef006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f077fe640 1 -- 172.21.15.114:0/1068980211 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f1f0008c370 con 0x55862537fa80 2024-04-13T02:45:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f0dc4a640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ef006b2d0 0x7f1ef006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x558625367ca0 0x5586254a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 --> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] -- osd_op(unknown.0.0:1 5.36 5:6ee5e2c4:::100000001f9.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5586254a4bd0 con 0x558625367ca0 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f0ec4c640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x558625367ca0 0x5586254a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f0dc4a640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ef006b2d0 0x7f1ef006d790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8057000 tx=0x7f1ef8051000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.809+0000 7f1f0ec4c640 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x558625367ca0 0x5586254a4690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f0ec4c640 1 -- 172.21.15.114:0/1068980211 <== osd.1 v2:172.21.15.114:6800/3111631753 1 ==== osd_op_reply(1 100000001f9.00000000 [getxattr (11) out=11b] v0'0 uv1 ondisk = 0) ==== 164+0+11 (crc 0 0 0) 0x7f1f08007740 con 0x558625367ca0 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x558625367ca0 msgr2=0x5586254a4690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x558625367ca0 0x5586254a4690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ef006b2d0 msgr2=0x7f1ef006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1ef006b2d0 0x7f1ef006d790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8057000 tx=0x7f1ef8051000 comp rx=0 tx=0).stop 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 msgr2=0x558625409d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 --2- 172.21.15.114:0/1068980211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55862537fa80 0x558625409d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x558625339490 tx=0x7f1f000032f0 comp rx=0 tx=0).stop 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f0ec4c640 1 -- 172.21.15.114:0/1068980211 reap_dead start 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 shutdown_connections 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 >> 172.21.15.114:0/1068980211 conn(0x558625363a20 msgr2=0x55862540ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 shutdown_connections 2024-04-13T02:45:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:40.810+0000 7f1f1143ff40 1 -- 172.21.15.114:0/1068980211 wait complete. 2024-04-13T02:45:40.816 INFO:teuthology.orchestra.run.smithi114.stdout:./file1 2024-04-13T02:45:40.816 DEBUG:teuthology.orchestra.run.smithi114:> ceph-dencoder type string_wrapper import - decode dump_json 2024-04-13T02:45:40.954 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:45:40.955 INFO:teuthology.orchestra.run.smithi114.stdout: "s": "./file1" 2024-04-13T02:45:40.955 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:45:40.955 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:40.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:40.963 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-13T02:45:40.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:40.979 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-13T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi114:> stdin-killer -- python3 -c ' 2024-04-13T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-04-13T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi114:> import stat 2024-04-13T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-13T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi114:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-13T02:45:41.038 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-04-13T02:45:41.142 INFO:teuthology.orchestra.run.smithi114.stdout:1099511628283 2024-04-13T02:45:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-13T02:45:41.150 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:41.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.290+0000 7f0173088640 1 Processor -- start 2024-04-13T02:45:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.290+0000 7f0173088640 1 -- start start 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f0173088640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f016c09ac00 0x7f016c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f0173088640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016c15f8a0 con 0x7f016c09afe0 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f0173088640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016c15fb80 con 0x7f016c0b6610 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f0173088640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f016c09c1d0 con 0x7f016c09ac00 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f0170e24640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f016c09ac00 0x7f016c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f016bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f016c09afe0 0x7f016c15ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52398/0 (socket says 172.21.15.114:52398) 2024-04-13T02:45:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.291+0000 7f016bfff640 1 -- 172.21.15.114:0/4136896130 learned_addr learned my addr 172.21.15.114:0/4136896130 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.292+0000 7f0170e24640 1 -- 172.21.15.114:0/4136896130 >> v1:172.21.15.130:6789/0 conn(0x7f016c0b6610 legacy=0x7f016c0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.292+0000 7f0170e24640 1 -- 172.21.15.114:0/4136896130 >> v1:172.21.15.114:6789/0 conn(0x7f016c09afe0 legacy=0x7f016c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.292+0000 7f0170e24640 1 -- 172.21.15.114:0/4136896130 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c15fe60 con 0x7f016c09ac00 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.292+0000 7f016b7fe640 1 -- 172.21.15.114:0/4136896130 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566584440 0 0) 0x7f016c15f8a0 con 0x7f016c09afe0 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.292+0000 7f0170e24640 1 --2- 172.21.15.114:0/4136896130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09ac00 0x7f016c06dd40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f015c0097a0 tx=0x7f015c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2eb5525a49b920e server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f016b7fe640 1 -- 172.21.15.114:0/4136896130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c038070 con 0x7f016c09ac00 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f016b7fe640 1 -- 172.21.15.114:0/4136896130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015c031700 con 0x7f016c09ac00 2024-04-13T02:45:41.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f016b7fe640 1 -- 172.21.15.114:0/4136896130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c031ad0 con 0x7f016c09ac00 2024-04-13T02:45:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 -- 172.21.15.114:0/4136896130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09ac00 msgr2=0x7f016c06dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 --2- 172.21.15.114:0/4136896130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09ac00 0x7f016c06dd40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f015c0097a0 tx=0x7f015c02b7a0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 -- 172.21.15.114:0/4136896130 shutdown_connections 2024-04-13T02:45:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 --2- 172.21.15.114:0/4136896130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09ac00 0x7f016c06dd40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 -- 172.21.15.114:0/4136896130 >> 172.21.15.114:0/4136896130 conn(0x7f016c0b4400 msgr2=0x7f016c0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 -- 172.21.15.114:0/4136896130 shutdown_connections 2024-04-13T02:45:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.293+0000 7f0173088640 1 -- 172.21.15.114:0/4136896130 wait complete. 2024-04-13T02:45:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.294+0000 7f0173088640 1 Processor -- start 2024-04-13T02:45:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.294+0000 7f0173088640 1 -- start start 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0173088640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f016c09ac00 0x7f016c1630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0173088640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 0x7f016c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0173088640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f016c0b6610 0x7f016c0709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0173088640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0b6080 con 0x7f016c09afe0 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0173088640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f016c15f5a0 con 0x7f016c0b6610 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0173088640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f016c09b440 con 0x7f016c09ac00 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f016bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 0x7f016c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f016bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 0x7f016c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37986/0 (socket says 172.21.15.114:37986) 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f016bfff640 1 -- 172.21.15.114:0/2398563720 learned_addr learned my addr 172.21.15.114:0/2398563720 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0171625640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f016c0b6610 0x7f016c0709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.295+0000 7f0170e24640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f016c09ac00 0x7f016c1630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f016bfff640 1 -- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f016c09ac00 msgr2=0x7f016c1630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f016bfff640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f016c09ac00 0x7f016c1630f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f016bfff640 1 -- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f016c0b6610 msgr2=0x7f016c0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f016bfff640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f016c0b6610 0x7f016c0709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f016bfff640 1 -- 172.21.15.114:0/2398563720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c1f4800 con 0x7f016c09afe0 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f0170e24640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f016c09ac00 0x7f016c1630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f0171625640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f016c0b6610 0x7f016c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f016bfff640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 0x7f016c070480 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f016000c4d0 tx=0x7f016000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160018070 con 0x7f016c09afe0 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0160007500 con 0x7f016c09afe0 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c1f5580 con 0x7f016c09afe0 2024-04-13T02:45:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160004a20 con 0x7f016c09afe0 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.296+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c1f4d80 con 0x7f016c09afe0 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.297+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f016c068c80 con 0x7f016c09afe0 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.297+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f016001b070 con 0x7f016c09afe0 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.298+0000 7f01697fa640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f015806c8f0 0x7f015806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.298+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f016008ae10 con 0x7f016c09afe0 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.298+0000 7f0170e24640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f015806c8f0 0x7f015806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.298+0000 7f0170e24640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f015806c8f0 0x7f015806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f015c035000 tx=0x7f015c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.302+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01600592d0 con 0x7f016c09afe0 2024-04-13T02:45:41.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.513+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f016c09b730 con 0x7f016c09afe0 2024-04-13T02:45:41.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.513+0000 7f01697fa640 1 -- 172.21.15.114:0/2398563720 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f0160058bd0 con 0x7f016c09afe0 2024-04-13T02:45:41.515 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:41.515 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:29.798058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:41.515 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f015806c8f0 msgr2=0x7f015806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f015806c8f0 0x7f015806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f015c035000 tx=0x7f015c008030 comp rx=0 tx=0).stop 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 msgr2=0x7f016c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 0x7f016c070480 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f016000c4d0 tx=0x7f016000c990 comp rx=0 tx=0).stop 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 shutdown_connections 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f016c0b6610 0x7f016c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f016c09afe0 0x7f016c070480 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f015806c8f0 0x7f015806edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 --2- 172.21.15.114:0/2398563720 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f016c09ac00 0x7f016c1630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 >> 172.21.15.114:0/2398563720 conn(0x7f016c0b4400 msgr2=0x7f016c0b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 shutdown_connections 2024-04-13T02:45:41.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.516+0000 7f0173088640 1 -- 172.21.15.114:0/2398563720 wait complete. 2024-04-13T02:45:41.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-13T02:45:41.652 INFO:teuthology.orchestra.run.smithi114.stdout:{"message":"","return_code":0} 2024-04-13T02:45:41.652 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-13T02:45:41.653 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-04-13T02:45:41.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.694+0000 7f1bdb436f40 1 Processor -- start 2024-04-13T02:45:41.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.694+0000 7f1bdb436f40 1 -- start start 2024-04-13T02:45:41.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.694+0000 7f1bdb436f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451dddfd90 0x56451de98640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bdb436f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de98b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bdb436f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451deb6450 0x56451deb68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bdb436f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56451dddd700 con 0x56451de9bbe0 2024-04-13T02:45:41.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bdb436f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56451dd85d00 con 0x56451dddfd90 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bdb436f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x56451de27db0 con 0x56451deb6450 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de98b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de98b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38016/0 (socket says 172.21.15.114:38016) 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/3976498759 learned_addr learned my addr 172.21.15.114:0/3976498759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd844b640 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451dddfd90 0x56451de98640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd8c4c640 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451deb6450 0x56451deb68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451deb6450 msgr2=0x56451deb68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451deb6450 0x56451deb68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451dddfd90 msgr2=0x56451de98640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451dddfd90 0x56451de98640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/3976498759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451de0d270 con 0x56451de9bbe0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd7c4a640 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de98b80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0001e00 tx=0x7f1bc000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d02ae9fc2281c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd6c48640 1 -- 172.21.15.114:0/3976498759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000be40 con 0x56451de9bbe0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd6c48640 1 -- 172.21.15.114:0/3976498759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc000f400 con 0x56451de9bbe0 2024-04-13T02:45:41.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.695+0000 7f1bd6c48640 1 -- 172.21.15.114:0/3976498759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000f7d0 con 0x56451de9bbe0 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 -- 172.21.15.114:0/3976498759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 msgr2=0x56451de98b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de98b80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0001e00 tx=0x7f1bc000b670 comp rx=0 tx=0).stop 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 -- 172.21.15.114:0/3976498759 shutdown_connections 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451deb6450 0x56451deb68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de98b80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/3976498759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451dddfd90 0x56451de98640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 -- 172.21.15.114:0/3976498759 >> 172.21.15.114:0/3976498759 conn(0x56451de083a0 msgr2=0x56451de0d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 -- 172.21.15.114:0/3976498759 shutdown_connections 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 -- 172.21.15.114:0/3976498759 wait complete. 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 Processor -- start 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.696+0000 7f1bdb436f40 1 -- start start 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bdb436f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451dddfd90 0x56451dea9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bdb436f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de99530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bdb436f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451deb6450 0x56451df454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bdb436f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x56451de9a1d0 con 0x56451de9bbe0 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bdb436f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56451de9aef0 con 0x56451deb6450 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bdb436f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x56451de9a790 con 0x56451dddfd90 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de99530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de99530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38030/0 (socket says 172.21.15.114:38030) 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/4251853343 learned_addr learned my addr 172.21.15.114:0/4251853343 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd8c4c640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451deb6450 0x56451df454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd844b640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451dddfd90 0x56451dea9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451dddfd90 msgr2=0x56451dea9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56451dddfd90 0x56451dea9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451deb6450 msgr2=0x56451df454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451deb6450 0x56451df454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd7c4a640 1 -- 172.21.15.114:0/4251853343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451dea9640 con 0x56451de9bbe0 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.697+0000 7f1bd8c4c640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56451deb6450 0x56451df454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:41.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.698+0000 7f1bd7c4a640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de99530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0002000 tx=0x7f1bc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.698+0000 7f1bd5c46640 1 -- 172.21.15.114:0/4251853343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0020070 con 0x56451de9bbe0 2024-04-13T02:45:41.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.698+0000 7f1bd5c46640 1 -- 172.21.15.114:0/4251853343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc001c440 con 0x56451de9bbe0 2024-04-13T02:45:41.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.698+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56451de91690 con 0x56451de9bbe0 2024-04-13T02:45:41.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.698+0000 7f1bd5c46640 1 -- 172.21.15.114:0/4251853343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc001c870 con 0x56451de9bbe0 2024-04-13T02:45:41.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.698+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56451de90640 con 0x56451de9bbe0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.699+0000 7f1bd5c46640 1 -- 172.21.15.114:0/4251853343 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bc0023070 con 0x56451de9bbe0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.699+0000 7f1bd5c46640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1bb806b300 0x7f1bb806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.699+0000 7f1bd5c46640 1 -- 172.21.15.114:0/4251853343 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f1bc008bf70 con 0x56451de9bbe0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.699+0000 7f1bd844b640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1bb806b300 0x7f1bb806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x56451df45f30 0x56451df4fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56451de99a70 con 0x56451df45f30 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bd8c4c640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x56451df45f30 0x56451df4fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bd844b640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1bb806b300 0x7f1bb806d7c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8055000 tx=0x7f1bc8050000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bd8c4c640 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x56451df45f30 0x56451df4fa90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bd8c4c640 1 -- 172.21.15.114:0/4251853343 <== osd.3 v2:172.21.15.114:6807/1156508834 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f1bd00097d0 con 0x56451df45f30 2024-04-13T02:45:41.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x56451df45f30 msgr2=0x56451df4fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x56451df45f30 0x56451df4fa90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1bb806b300 msgr2=0x7f1bb806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f1bb806b300 0x7f1bb806d7c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8055000 tx=0x7f1bc8050000 comp rx=0 tx=0).stop 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 msgr2=0x56451de99530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bdb436f40 1 --2- 172.21.15.114:0/4251853343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56451de9bbe0 0x56451de99530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0002000 tx=0x7f1bc0000ed0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.700+0000 7f1bd8c4c640 1 -- 172.21.15.114:0/4251853343 reap_dead start 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.701+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 shutdown_connections 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.701+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 >> 172.21.15.114:0/4251853343 conn(0x56451de083a0 msgr2=0x56451de98590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.701+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 shutdown_connections 2024-04-13T02:45:41.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.701+0000 7f1bdb436f40 1 -- 172.21.15.114:0/4251853343 wait complete. 2024-04-13T02:45:41.707 INFO:teuthology.orchestra.run.smithi114.stdout:Y��alphaparent_a 2024-04-13T02:45:41.707 DEBUG:teuthology.orchestra.run.smithi114:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-13T02:45:41.792 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:45:41.792 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628283, 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "ancestors": [ 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "dirino": 1099511628282, 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "dname": "alpha", 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "version": 2 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "dirino": 1, 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "dname": "parent_a", 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "version": 18 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "pool": 5, 2024-04-13T02:45:41.793 INFO:teuthology.orchestra.run.smithi114.stdout: "old_pools": [] 2024-04-13T02:45:41.794 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:45:41.794 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:41.795 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2024-04-13T02:45:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.875+0000 7f7831835f40 1 Processor -- start 2024-04-13T02:45:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.875+0000 7f7831835f40 1 -- start start 2024-04-13T02:45:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7831835f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd798b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7831835f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd7b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7831835f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd7b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7831835f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x555cdd727440 con 0x555cdd726af0 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7831835f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555cdd687d00 con 0x555cdd79bac0 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7831835f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555cdd6df670 con 0x555cdd6deef0 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd7b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd7b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38054/0 (socket says 172.21.15.114:38054) 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 -- 172.21.15.114:0/1067525897 learned_addr learned my addr 172.21.15.114:0/1067525897 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f782f04c640 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd7b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f782e84b640 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd798b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 -- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 msgr2=0x555cdd798b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd798b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 -- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 msgr2=0x555cdd7b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd7b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 -- 172.21.15.114:0/1067525897 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cdd7937a0 con 0x555cdd726af0 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f782e84b640 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd798b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.876+0000 7f7827fff640 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd7b4ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f781800b240 tx=0x7f781800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575249fa59a5f214 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f782d849640 1 -- 172.21.15.114:0/1067525897 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818008070 con 0x555cdd726af0 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f782d849640 1 -- 172.21.15.114:0/1067525897 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f781800d500 con 0x555cdd726af0 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f782d849640 1 -- 172.21.15.114:0/1067525897 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781800d8f0 con 0x555cdd726af0 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 -- 172.21.15.114:0/1067525897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 msgr2=0x555cdd7b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd7b4ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f781800b240 tx=0x7f781800b700 comp rx=0 tx=0).stop 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 -- 172.21.15.114:0/1067525897 shutdown_connections 2024-04-13T02:45:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd7b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd7b4ee0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 --2- 172.21.15.114:0/1067525897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd798b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 -- 172.21.15.114:0/1067525897 >> 172.21.15.114:0/1067525897 conn(0x555cdd70a3a0 msgr2=0x555cdd70e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 -- 172.21.15.114:0/1067525897 shutdown_connections 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.877+0000 7f7831835f40 1 -- 172.21.15.114:0/1067525897 wait complete. 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 Processor -- start 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 -- start start 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd7b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd724eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd70e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x555cdd70f8e0 con 0x555cdd726af0 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555cdd7b5420 con 0x555cdd79bac0 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.878+0000 7f7831835f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555cdd70e160 con 0x555cdd6deef0 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd724eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd724eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38058/0 (socket says 172.21.15.114:38058) 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 -- 172.21.15.114:0/2238898404 learned_addr learned my addr 172.21.15.114:0/2238898404 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f782f04c640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd70e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f782e84b640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd7b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 -- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 msgr2=0x555cdd7b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555cdd6deef0 0x555cdd7b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 -- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 msgr2=0x555cdd70e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd70e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 -- 172.21.15.114:0/2238898404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cdd796d40 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f782f04c640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555cdd79bac0 0x555cdd70e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7827fff640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd724eb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7818000c00 tx=0x7f7818000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f782c847640 1 -- 172.21.15.114:0/2238898404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818021030 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f782c847640 1 -- 172.21.15.114:0/2238898404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f781801c650 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f782c847640 1 -- 172.21.15.114:0/2238898404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781801c8a0 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555cdd728990 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.879+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cdd7246b0 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.880+0000 7f782c847640 1 -- 172.21.15.114:0/2238898404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7818024070 con 0x555cdd726af0 2024-04-13T02:45:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f782c847640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f781006b2d0 0x7f781006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f782c847640 1 -- 172.21.15.114:0/2238898404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f781808ba50 con 0x555cdd726af0 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f782e84b640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f781006b2d0 0x7f781006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f7831835f40 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555cdd7b6c90 0x555cdd793bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555cdd794130 con 0x555cdd7b6c90 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f782f04c640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555cdd7b6c90 0x555cdd793bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f782e84b640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f781006b2d0 0x7f781006d790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7820009850 tx=0x7f7820005a00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.881+0000 7f782f04c640 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555cdd7b6c90 0x555cdd793bf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f782f04c640 1 -- 172.21.15.114:0/2238898404 <== osd.3 v2:172.21.15.114:6807/1156508834 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f782805d040 con 0x555cdd7b6c90 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555cdd7b6c90 msgr2=0x555cdd793bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555cdd7b6c90 0x555cdd793bf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f781006b2d0 msgr2=0x7f781006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f781006b2d0 0x7f781006d790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7820009850 tx=0x7f7820005a00 comp rx=0 tx=0).stop 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 msgr2=0x555cdd724eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 --2- 172.21.15.114:0/2238898404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555cdd726af0 0x555cdd724eb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7818000c00 tx=0x7f7818000ed0 comp rx=0 tx=0).stop 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f782f04c640 1 -- 172.21.15.114:0/2238898404 reap_dead start 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 shutdown_connections 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 >> 172.21.15.114:0/2238898404 conn(0x555cdd70a3a0 msgr2=0x555cdd7b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 shutdown_connections 2024-04-13T02:45:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:41.882+0000 7f7831835f40 1 -- 172.21.15.114:0/2238898404 wait complete. 2024-04-13T02:45:41.891 INFO:teuthology.orchestra.run.smithi114.stdout:@@ 2024-04-13T02:45:41.892 DEBUG:teuthology.orchestra.run.smithi114:> ceph-dencoder type file_layout_t import - decode dump_json 2024-04-13T02:45:41.976 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:45:41.976 INFO:teuthology.orchestra.run.smithi114.stdout: "stripe_unit": 4194304, 2024-04-13T02:45:41.977 INFO:teuthology.orchestra.run.smithi114.stdout: "stripe_count": 1, 2024-04-13T02:45:41.977 INFO:teuthology.orchestra.run.smithi114.stdout: "object_size": 4194304, 2024-04-13T02:45:41.977 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_id": 5, 2024-04-13T02:45:41.977 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_ns": "" 2024-04-13T02:45:41.977 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:45:41.977 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:41.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:41.979 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_b) 2024-04-13T02:45:42.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:42.035 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_a/alpha parent_b/alpha) 2024-04-13T02:45:42.093 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.233+0000 7f0ff8d1e640 1 Processor -- start 2024-04-13T02:45:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.233+0000 7f0ff8d1e640 1 -- start start 2024-04-13T02:45:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff8d1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff8d1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ff40af7a0 0x7f0ff415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff8d1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff40b2970 con 0x7f0ff40b1200 2024-04-13T02:45:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff8d1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff41466f0 con 0x7f0ff40af7a0 2024-04-13T02:45:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff8d1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff40b2c50 con 0x7f0ff4146310 2024-04-13T02:45:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff259c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff2d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ff40af7a0 0x7f0ff415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff2d9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ff40af7a0 0x7f0ff415d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:44462/0 (socket says 172.21.15.114:44462) 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff2d9d640 1 -- 172.21.15.114:0/3186868767 learned_addr learned my addr 172.21.15.114:0/3186868767 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.234+0000 7f0ff1d9b640 1 --1- 172.21.15.114:0/3186868767 >> v1:172.21.15.130:6789/0 conn(0x7f0ff40b1200 0x7f0ff40af090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:39102/0 (socket says 172.21.15.114:39102) 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.235+0000 7f0ff2d9d640 1 -- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 msgr2=0x7f0ff40b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.235+0000 7f0ff2d9d640 1 --2- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff40b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.235+0000 7f0ff2d9d640 1 -- 172.21.15.114:0/3186868767 >> v1:172.21.15.130:6789/0 conn(0x7f0ff40b1200 legacy=0x7f0ff40af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.235+0000 7f0ff2d9d640 1 -- 172.21.15.114:0/3186868767 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40b2f30 con 0x7f0ff40af7a0 2024-04-13T02:45:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.235+0000 7f0ff259c640 1 --2- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.235+0000 7f0ff2d9d640 1 --2- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415d4e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009e50 tx=0x7f0fec02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d205e65fbd6bb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff159a640 1 -- 172.21.15.114:0/3186868767 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec02cb00 con 0x7f0ff40af7a0 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff159a640 1 -- 172.21.15.114:0/3186868767 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fec02cca0 con 0x7f0ff40af7a0 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff159a640 1 -- 172.21.15.114:0/3186868767 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec034610 con 0x7f0ff40af7a0 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 msgr2=0x7f0ff415d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415d4e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009e50 tx=0x7f0fec02bf60 comp rx=0 tx=0).stop 2024-04-13T02:45:42.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3186868767 shutdown_connections 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415d4e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3186868767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3186868767 >> 172.21.15.114:0/3186868767 conn(0x7f0ff40b6f50 msgr2=0x7f0ff409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3186868767 shutdown_connections 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.236+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3186868767 wait complete. 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 Processor -- start 2024-04-13T02:45:42.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 -- start start 2024-04-13T02:45:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 0x7f0ff40b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff4143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40b2520 con 0x7f0ff40b1200 2024-04-13T02:45:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff415cf10 con 0x7f0ff40af7a0 2024-04-13T02:45:42.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff8d1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff40b26a0 con 0x7f0ff4146310 2024-04-13T02:45:42.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 0x7f0ff40b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 0x7f0ff40b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38074/0 (socket says 172.21.15.114:38074) 2024-04-13T02:45:42.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.238+0000 7f0ff1d9b640 1 -- 172.21.15.114:0/3135115650 learned_addr learned my addr 172.21.15.114:0/3135115650 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:42.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff2d9d640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff4143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff259c640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff1d9b640 1 -- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 msgr2=0x7f0ff4143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff1d9b640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff4143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff1d9b640 1 -- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 msgr2=0x7f0ff415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff1d9b640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff1d9b640 1 -- 172.21.15.114:0/3135115650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff415c7e0 con 0x7f0ff40b1200 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff1d9b640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 0x7f0ff40b55c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c470 tx=0x7f0fe8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80074e0 con 0x7f0ff40b1200 2024-04-13T02:45:42.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe8007680 con 0x7f0ff40b1200 2024-04-13T02:45:42.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8004a20 con 0x7f0ff40b1200 2024-04-13T02:45:42.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff40b5f40 con 0x7f0ff40b1200 2024-04-13T02:45:42.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.239+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff40b6500 con 0x7f0ff40b1200 2024-04-13T02:45:42.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.240+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff4068c80 con 0x7f0ff40b1200 2024-04-13T02:45:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.241+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0fe801a020 con 0x7f0ff40b1200 2024-04-13T02:45:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.241+0000 7f0fe2ffd640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0fd406c8f0 0x7f0fd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.241+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0fe808b160 con 0x7f0ff40b1200 2024-04-13T02:45:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.241+0000 7f0ff259c640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0fd406c8f0 0x7f0fd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.241+0000 7f0ff259c640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0fd406c8f0 0x7f0fd406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009560 tx=0x7f0fe4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.245+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0fe8058fd0 con 0x7f0ff40b1200 2024-04-13T02:45:42.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.456+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ff406c650 con 0x7f0ff40b1200 2024-04-13T02:45:42.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.456+0000 7f0fe2ffd640 1 -- 172.21.15.114:0/3135115650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5190 (secure 0 0 0) 0x7f0fe805d2d0 con 0x7f0ff40b1200 2024-04-13T02:45:42.457 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:42.457 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:29.798058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:42.457 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 13 2024-04-13T02:45:42.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0fd406c8f0 msgr2=0x7f0fd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0fd406c8f0 0x7f0fd406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009560 tx=0x7f0fe4009190 comp rx=0 tx=0).stop 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 msgr2=0x7f0ff40b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 0x7f0ff40b55c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c470 tx=0x7f0fe8001e70 comp rx=0 tx=0).stop 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 shutdown_connections 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0fd406c8f0 0x7f0fd406edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff4146310 0x7f0ff4143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ff40b1200 0x7f0ff40b55c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 --2- 172.21.15.114:0/3135115650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff40af7a0 0x7f0ff415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 >> 172.21.15.114:0/3135115650 conn(0x7f0ff40b6f50 msgr2=0x7f0ff413f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:42.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 shutdown_connections 2024-04-13T02:45:42.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.458+0000 7f0ff8d1e640 1 -- 172.21.15.114:0/3135115650 wait complete. 2024-04-13T02:45:42.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-13T02:45:42.592 INFO:teuthology.orchestra.run.smithi114.stdout:{"message":"","return_code":0} 2024-04-13T02:45:42.593 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-13T02:45:42.593 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-04-13T02:45:42.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.633+0000 7f20b1572f40 1 Processor -- start 2024-04-13T02:45:42.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 -- start start 2024-04-13T02:45:42.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766a21ef0 0x555766a52410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766af9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766adeac0 0x555766a500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5557669cad00 con 0x555766a69af0 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5557669ced40 con 0x555766adeac0 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20b1572f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555766a22910 con 0x555766a21ef0 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766af9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766af9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38096/0 (socket says 172.21.15.114:38096) 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 -- 172.21.15.114:0/2821731211 learned_addr learned my addr 172.21.15.114:0/2821731211 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 -- 172.21.15.114:0/2821731211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766a21ef0 msgr2=0x555766a52410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766a21ef0 0x555766a52410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 -- 172.21.15.114:0/2821731211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766adeac0 msgr2=0x555766a500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766adeac0 0x555766a500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.634+0000 7f20ae64a640 1 -- 172.21.15.114:0/2821731211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555766a24640 con 0x555766a69af0 2024-04-13T02:45:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20ae64a640 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766af9400 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20a4002de0 tx=0x7f20a400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27feebe802689563 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20ad648640 1 -- 172.21.15.114:0/2821731211 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a400f400 con 0x555766a69af0 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20ad648640 1 -- 172.21.15.114:0/2821731211 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4014070 con 0x555766a69af0 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20ad648640 1 -- 172.21.15.114:0/2821731211 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a400f7e0 con 0x555766a69af0 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 -- 172.21.15.114:0/2821731211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 msgr2=0x555766af9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766af9400 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20a4002de0 tx=0x7f20a400b5b0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 -- 172.21.15.114:0/2821731211 shutdown_connections 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766adeac0 0x555766a500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766af9400 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 --2- 172.21.15.114:0/2821731211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766a21ef0 0x555766a52410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 -- 172.21.15.114:0/2821731211 >> 172.21.15.114:0/2821731211 conn(0x555766a4d3a0 msgr2=0x555766a23db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 -- 172.21.15.114:0/2821731211 shutdown_connections 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.635+0000 7f20b1572f40 1 -- 172.21.15.114:0/2821731211 wait complete. 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.636+0000 7f20b1572f40 1 Processor -- start 2024-04-13T02:45:42.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.636+0000 7f20b1572f40 1 -- start start 2024-04-13T02:45:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766a21ef0 0x555766afabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766b88d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766adeac0 0x555766b892a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x555766a52950 con 0x555766a69af0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555766addbb0 con 0x555766a21ef0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555766ac9340 con 0x555766adeac0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766b88d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766b88d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38112/0 (socket says 172.21.15.114:38112) 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 -- 172.21.15.114:0/1452756348 learned_addr learned my addr 172.21.15.114:0/1452756348 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20aee4b640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766a21ef0 0x555766afabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20af64c640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766adeac0 0x555766b892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 -- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766adeac0 msgr2=0x555766b892a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766adeac0 0x555766b892a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 -- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766a21ef0 msgr2=0x555766afabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766a21ef0 0x555766afabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 -- 172.21.15.114:0/1452756348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555766ae2130 con 0x555766a69af0 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20aee4b640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555766a21ef0 0x555766afabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20af64c640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555766adeac0 0x555766b892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20ae64a640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766b88d60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20a400bab0 tx=0x7f20a4001fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f2097fff640 1 -- 172.21.15.114:0/1452756348 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4028070 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f2097fff640 1 -- 172.21.15.114:0/1452756348 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4019480 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555766ae1b70 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f2097fff640 1 -- 172.21.15.114:0/1452756348 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4019870 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.637+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555766b87440 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f2097fff640 1 -- 172.21.15.114:0/1452756348 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20a402b070 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f2097fff640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f209c06b2d0 0x7f209c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f20aee4b640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f209c06b2d0 0x7f209c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f2097fff640 1 -- 172.21.15.114:0/1452756348 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f20a408bcf0 con 0x555766a69af0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f20b1572f40 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555766adf230 0x555766ad8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555766ad9ce0 con 0x555766adf230 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f20af64c640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555766adf230 0x555766ad8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.639+0000 7f20aee4b640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f209c06b2d0 0x7f209c06d790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f20a0057000 tx=0x7f20a0051000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20af64c640 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555766adf230 0x555766ad8a50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20af64c640 1 -- 172.21.15.114:0/1452756348 <== osd.3 v2:172.21.15.114:6807/1156508834 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv2 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f20a8004540 con 0x555766adf230 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555766adf230 msgr2=0x555766ad8a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x555766adf230 0x555766ad8a50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f209c06b2d0 msgr2=0x7f209c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f209c06b2d0 0x7f209c06d790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f20a0057000 tx=0x7f20a0051000 comp rx=0 tx=0).stop 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 msgr2=0x555766b88d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 --2- 172.21.15.114:0/1452756348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555766a69af0 0x555766b88d60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20a400bab0 tx=0x7f20a4001fe0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20af64c640 1 -- 172.21.15.114:0/1452756348 reap_dead start 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 shutdown_connections 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 >> 172.21.15.114:0/1452756348 conn(0x555766a4d3a0 msgr2=0x555766af9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 shutdown_connections 2024-04-13T02:45:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.640+0000 7f20b1572f40 1 -- 172.21.15.114:0/1452756348 wait complete. 2024-04-13T02:45:42.646 INFO:teuthology.orchestra.run.smithi114.stdout:Y��alphaparent_b 2024-04-13T02:45:42.646 DEBUG:teuthology.orchestra.run.smithi114:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-13T02:45:42.731 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "ino": 1099511628283, 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "ancestors": [ 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "dirino": 1099511628284, 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "dname": "alpha", 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "version": 3 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "dirino": 1, 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "dname": "parent_b", 2024-04-13T02:45:42.732 INFO:teuthology.orchestra.run.smithi114.stdout: "version": 25 2024-04-13T02:45:42.733 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-13T02:45:42.733 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-04-13T02:45:42.733 INFO:teuthology.orchestra.run.smithi114.stdout: "pool": 5, 2024-04-13T02:45:42.733 INFO:teuthology.orchestra.run.smithi114.stdout: "old_pools": [] 2024-04-13T02:45:42.733 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:45:42.733 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:42.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-04-13T02:45:42.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.877+0000 7fc6f4860640 1 Processor -- start 2024-04-13T02:45:42.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.878+0000 7fc6f4860640 1 -- start start 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.878+0000 7fc6f4860640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 0x7fc6f00b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6f4860640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6f00b3cb0 0x7fc6f00cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6f4860640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f0163670 con 0x7fc6f015ecb0 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6f4860640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f00b4120 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6f4860640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f00b26a0 con 0x7fc6f00b2220 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 0x7fc6f00b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6eed9d640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6f00b3cb0 0x7fc6f00cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 0x7fc6f00b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:40588/0 (socket says 172.21.15.114:40588) 2024-04-13T02:45:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 -- 172.21.15.114:0/2301348340 learned_addr learned my addr 172.21.15.114:0/2301348340 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 -- 172.21.15.114:0/2301348340 >> v2:172.21.15.130:3300/0 conn(0x7fc6f00b3cb0 msgr2=0x7fc6f00cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 --2- 172.21.15.114:0/2301348340 >> v2:172.21.15.130:3300/0 conn(0x7fc6f00b3cb0 0x7fc6f00cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 -- 172.21.15.114:0/2301348340 >> v1:172.21.15.130:6789/0 conn(0x7fc6f015ecb0 legacy=0x7fc6f00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6edd9b640 1 -- 172.21.15.114:0/2301348340 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f0162af0 con 0x7fc6f00b2220 2024-04-13T02:45:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.879+0000 7fc6eed9d640 1 --2- 172.21.15.114:0/2301348340 >> v2:172.21.15.130:3300/0 conn(0x7fc6f00b3cb0 0x7fc6f00cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:42.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.880+0000 7fc6edd9b640 1 --2- 172.21.15.114:0/2301348340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 0x7fc6f00b3770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009870 tx=0x7fc6e402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e5686e60c42b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.880+0000 7fc6ed59a640 1 -- 172.21.15.114:0/2301348340 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4035020 con 0x7fc6f00b2220 2024-04-13T02:45:42.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.880+0000 7fc6ed59a640 1 -- 172.21.15.114:0/2301348340 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e4031640 con 0x7fc6f00b2220 2024-04-13T02:45:42.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.880+0000 7fc6ed59a640 1 -- 172.21.15.114:0/2301348340 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e402d040 con 0x7fc6f00b2220 2024-04-13T02:45:42.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 -- 172.21.15.114:0/2301348340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 msgr2=0x7fc6f00b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 --2- 172.21.15.114:0/2301348340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 0x7fc6f00b3770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009870 tx=0x7fc6e402b8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 -- 172.21.15.114:0/2301348340 shutdown_connections 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 --2- 172.21.15.114:0/2301348340 >> v2:172.21.15.130:3300/0 conn(0x7fc6f00b3cb0 0x7fc6f00cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 --2- 172.21.15.114:0/2301348340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f00b2220 0x7fc6f00b3770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 -- 172.21.15.114:0/2301348340 >> 172.21.15.114:0/2301348340 conn(0x7fc6f00d2750 msgr2=0x7fc6f00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 -- 172.21.15.114:0/2301348340 shutdown_connections 2024-04-13T02:45:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.881+0000 7fc6f4860640 1 -- 172.21.15.114:0/2301348340 wait complete. 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.882+0000 7fc6f4860640 1 Processor -- start 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.882+0000 7fc6f4860640 1 -- start start 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6f4860640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6f00b2220 0x7fc6f0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6f4860640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 0x7fc6f00b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6f4860640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f015ecb0 0x7fc6f015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6f4860640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f0163390 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6f4860640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01630b0 con 0x7fc6f00b2220 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6f4860640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f00cef30 con 0x7fc6f015ecb0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6edd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 0x7fc6f00b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6edd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 0x7fc6f00b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38116/0 (socket says 172.21.15.114:38116) 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6edd9b640 1 -- 172.21.15.114:0/3520729911 learned_addr learned my addr 172.21.15.114:0/3520729911 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6ee59c640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6f00b2220 0x7fc6f0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.883+0000 7fc6eed9d640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f015ecb0 0x7fc6f015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6edd9b640 1 -- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f015ecb0 msgr2=0x7fc6f015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6edd9b640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f015ecb0 0x7fc6f015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6edd9b640 1 -- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6f00b2220 msgr2=0x7fc6f0153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6edd9b640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6f00b2220 0x7fc6f0153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6edd9b640 1 -- 172.21.15.114:0/3520729911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f0153b60 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6edd9b640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 0x7fc6f00b5f00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4000c00 tx=0x7fc6e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4040070 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e40399f0 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4035040 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f00b6870 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.884+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f00b6e30 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.885+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f0068db0 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.885+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6e4038020 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.886+0000 7fc6deffd640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc6d006c920 0x7fc6d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:42.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.886+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc6e40ad1d0 con 0x7fc6f00b3cb0 2024-04-13T02:45:42.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.886+0000 7fc6ee59c640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc6d006c920 0x7fc6d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:42.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.886+0000 7fc6ee59c640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc6d006c920 0x7fc6d006ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0001f10 tx=0x7fc6e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:42.890+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6e407b040 con 0x7fc6f00b3cb0 2024-04-13T02:45:43.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:43.065+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7fc6f006f390 con 0x7fc6f00b3cb0 2024-04-13T02:45:44.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.009+0000 7fc6deffd640 1 -- 172.21.15.114:0/3520729911 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v32) ==== 124+0+0 (secure 0 0 0) 0x7fc6e407f340 con 0x7fc6f00b3cb0 2024-04-13T02:45:44.010 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'data_new' created 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.012+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc6d006c920 msgr2=0x7fc6d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.012+0000 7fc6f4860640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc6d006c920 0x7fc6d006ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0001f10 tx=0x7fc6e0009040 comp rx=0 tx=0).stop 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.012+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 msgr2=0x7fc6f00b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.012+0000 7fc6f4860640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 0x7fc6f00b5f00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4000c00 tx=0x7fc6e40046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 shutdown_connections 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc6d006c920 0x7fc6d006ede0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc6f015ecb0 0x7fc6f015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f00b3cb0 0x7fc6f00b5f00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 --2- 172.21.15.114:0/3520729911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6f00b2220 0x7fc6f0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 >> 172.21.15.114:0/3520729911 conn(0x7fc6f00d2750 msgr2=0x7fc6f00cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:44.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 shutdown_connections 2024-04-13T02:45:44.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.013+0000 7fc6f4860640 1 -- 172.21.15.114:0/3520729911 wait complete. 2024-04-13T02:45:44.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-04-13T02:45:44.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.137+0000 7fdb641cc640 1 Processor -- start 2024-04-13T02:45:44.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.138+0000 7fdb641cc640 1 -- start start 2024-04-13T02:45:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.138+0000 7fdb641cc640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdb5c0b3720 0x7fdb5c0b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.138+0000 7fdb641cc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.138+0000 7fdb641cc640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5c0ba4d0 con 0x7fdb5c15ecc0 2024-04-13T02:45:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.138+0000 7fdb641cc640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5c15f0a0 con 0x7fdb5c0b3720 2024-04-13T02:45:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.138+0000 7fdb641cc640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c0ba280 con 0x7fdb5c0b3c70 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb62769640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb62769640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:40606/0 (socket says 172.21.15.114:40606) 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb62769640 1 -- 172.21.15.114:0/1142456367 learned_addr learned my addr 172.21.15.114:0/1142456367 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb61767640 1 --2- 172.21.15.114:0/1142456367 >> v2:172.21.15.130:3300/0 conn(0x7fdb5c0b3720 0x7fdb5c0b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb61767640 1 -- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 msgr2=0x7fdb5c0b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb61767640 1 --2- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb61767640 1 -- 172.21.15.114:0/1142456367 >> v1:172.21.15.130:6789/0 conn(0x7fdb5c15ecc0 legacy=0x7fdb5c0d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb61767640 1 -- 172.21.15.114:0/1142456367 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c0ba7b0 con 0x7fdb5c0b3720 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.139+0000 7fdb62769640 1 --2- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.140+0000 7fdb61767640 1 --2- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0b95f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0097a0 tx=0x7fdb4c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0321aff724efc38 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.140+0000 7fdb60f66640 1 -- 172.21.15.114:0/1142456367 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c035020 con 0x7fdb5c0b3720 2024-04-13T02:45:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.140+0000 7fdb60f66640 1 -- 172.21.15.114:0/1142456367 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c031830 con 0x7fdb5c0b3720 2024-04-13T02:45:44.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.140+0000 7fdb60f66640 1 -- 172.21.15.114:0/1142456367 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c031c00 con 0x7fdb5c0b3720 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 -- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3720 msgr2=0x7fdb5c0b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 --2- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0b95f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0097a0 tx=0x7fdb4c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 -- 172.21.15.114:0/1142456367 shutdown_connections 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 --2- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 --2- 172.21.15.114:0/1142456367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0b95f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 -- 172.21.15.114:0/1142456367 >> 172.21.15.114:0/1142456367 conn(0x7fdb5c073480 msgr2=0x7fdb5c073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 -- 172.21.15.114:0/1142456367 shutdown_connections 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.141+0000 7fdb641cc640 1 -- 172.21.15.114:0/1142456367 wait complete. 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.142+0000 7fdb641cc640 1 Processor -- start 2024-04-13T02:45:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.142+0000 7fdb641cc640 1 -- start start 2024-04-13T02:45:44.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:44.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:44.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c15ecc0 0x7fdb5c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:44.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c0b8aa0 con 0x7fdb5c0b3720 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c0b90d0 con 0x7fdb5c0b3c70 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c0d3440 con 0x7fdb5c15ecc0 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38124/0 (socket says 172.21.15.114:38124) 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 -- 172.21.15.114:0/2081219996 learned_addr learned my addr 172.21.15.114:0/2081219996 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61767640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb62769640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c15ecc0 0x7fdb5c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 -- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c15ecc0 msgr2=0x7fdb5c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c15ecc0 0x7fdb5c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 -- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3c70 msgr2=0x7fdb5c0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 -- 172.21.15.114:0/2081219996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c0c9e20 con 0x7fdb5c0b3720 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb61f68640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0c94b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800c3f0 tx=0x7fdb5800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb580052d0 con 0x7fdb5c0b3720 2024-04-13T02:45:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb58005490 con 0x7fdb5c0b3720 2024-04-13T02:45:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c15f470 con 0x7fdb5c0b3720 2024-04-13T02:45:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb58007260 con 0x7fdb5c0b3720 2024-04-13T02:45:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.143+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c15fa30 con 0x7fdb5c0b3720 2024-04-13T02:45:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.144+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c068c80 con 0x7fdb5c0b3720 2024-04-13T02:45:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.145+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb58007400 con 0x7fdb5c0b3720 2024-04-13T02:45:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.145+0000 7fdb527fc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb4006c8f0 0x7fdb4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.145+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6072+0+0 (secure 0 0 0) 0x7fdb5808b0d0 con 0x7fdb5c0b3720 2024-04-13T02:45:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.145+0000 7fdb61767640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb4006c8f0 0x7fdb4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.146+0000 7fdb61767640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb4006c8f0 0x7fdb4006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c036000 tx=0x7fdb4c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:44.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.150+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb58058d40 con 0x7fdb5c0b3720 2024-04-13T02:45:44.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:44.364+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7fdb5c161070 con 0x7fdb5c0b3720 2024-04-13T02:45:45.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.021+0000 7fdb527fc640 1 -- 172.21.15.114:0/2081219996 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v14) ==== 131+0+0 (secure 0 0 0) 0x7fdb5805d040 con 0x7fdb5c0b3720 2024-04-13T02:45:45.022 INFO:teuthology.orchestra.run.smithi114.stderr:added data pool 6 to fsmap 2024-04-13T02:45:45.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.024+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb4006c8f0 msgr2=0x7fdb4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.024+0000 7fdb641cc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb4006c8f0 0x7fdb4006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c036000 tx=0x7fdb4c008030 comp rx=0 tx=0).stop 2024-04-13T02:45:45.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.024+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 msgr2=0x7fdb5c0c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.024+0000 7fdb641cc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0c94b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800c3f0 tx=0x7fdb5800c8b0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.024+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 shutdown_connections 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb4006c8f0 0x7fdb4006edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb5c15ecc0 0x7fdb5c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb5c0b3c70 0x7fdb5c0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 --2- 172.21.15.114:0/2081219996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb5c0b3720 0x7fdb5c0c94b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 >> 172.21.15.114:0/2081219996 conn(0x7fdb5c073480 msgr2=0x7fdb5c15dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 shutdown_connections 2024-04-13T02:45:45.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.025+0000 7fdb641cc640 1 -- 172.21.15.114:0/2081219996 wait complete. 2024-04-13T02:45:45.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.139+0000 7f246ce60640 1 Processor -- start 2024-04-13T02:45:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.139+0000 7f246ce60640 1 -- start start 2024-04-13T02:45:45.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.140+0000 7f246ce60640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24680d1300 0x7f24680d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.140+0000 7f246ce60640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f24680b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.140+0000 7f246ce60640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24680d2d90 con 0x7f246815eac0 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.140+0000 7f246ce60640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f24680d1cd0 con 0x7f24680d1300 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.140+0000 7f246ce60640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f24680d3070 con 0x7f24680b3470 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f2465d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24680d1300 0x7f24680d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f246659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f246815eac0 0x7f24680d3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52422/0 (socket says 172.21.15.114:52422) 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f246659c640 1 -- 172.21.15.114:0/4206946311 learned_addr learned my addr 172.21.15.114:0/4206946311 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f2465d9b640 1 -- 172.21.15.114:0/4206946311 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 msgr2=0x7f24680b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f2465d9b640 1 --2- 172.21.15.114:0/4206946311 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f24680b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f2465d9b640 1 -- 172.21.15.114:0/4206946311 >> v1:172.21.15.114:6789/0 conn(0x7f246815eac0 legacy=0x7f24680d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f2465d9b640 1 -- 172.21.15.114:0/4206946311 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24680d3350 con 0x7f24680d1300 2024-04-13T02:45:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.141+0000 7f246559a640 1 -- 172.21.15.114:0/4206946311 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135211914 0 0) 0x7f24680d2d90 con 0x7f246815eac0 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f2465d9b640 1 --2- 172.21.15.114:0/4206946311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24680d1300 0x7f24680d1790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f245c0097a0 tx=0x7f245c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7090e253adb3e258 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246559a640 1 -- 172.21.15.114:0/4206946311 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c035020 con 0x7f24680d1300 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246559a640 1 -- 172.21.15.114:0/4206946311 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c031830 con 0x7f24680d1300 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246559a640 1 -- 172.21.15.114:0/4206946311 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c031c00 con 0x7f24680d1300 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 -- 172.21.15.114:0/4206946311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24680d1300 msgr2=0x7f24680d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 --2- 172.21.15.114:0/4206946311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24680d1300 0x7f24680d1790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f245c0097a0 tx=0x7f245c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 -- 172.21.15.114:0/4206946311 shutdown_connections 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 --2- 172.21.15.114:0/4206946311 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f24680b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 --2- 172.21.15.114:0/4206946311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24680d1300 0x7f24680d1790 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 -- 172.21.15.114:0/4206946311 >> 172.21.15.114:0/4206946311 conn(0x7f2468073690 msgr2=0x7f246806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 -- 172.21.15.114:0/4206946311 shutdown_connections 2024-04-13T02:45:45.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.142+0000 7f246ce60640 1 -- 172.21.15.114:0/4206946311 wait complete. 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 Processor -- start 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 -- start start 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f2468159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24680d1300 0x7f246815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 0x7f24680b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f246815eea0 con 0x7f246815eac0 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24680d3910 con 0x7f24680d1300 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f246ce60640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f24680d4590 con 0x7f24680b3470 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f2466d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 0x7f24680b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f2466d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 0x7f24680b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38144/0 (socket says 172.21.15.114:38144) 2024-04-13T02:45:45.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.144+0000 7f2466d9d640 1 -- 172.21.15.114:0/1579514782 learned_addr learned my addr 172.21.15.114:0/1579514782 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2465d9b640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24680d1300 0x7f246815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f246659c640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f2468159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2466d9d640 1 -- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 msgr2=0x7f2468159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2466d9d640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f2468159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2466d9d640 1 -- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24680d1300 msgr2=0x7f246815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2466d9d640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24680d1300 0x7f246815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2466d9d640 1 -- 172.21.15.114:0/1579514782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24681599e0 con 0x7f246815eac0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f246659c640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f2468159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2466d9d640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 0x7f24680b7ef0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2460009fd0 tx=0x7f246000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460011830 con 0x7f246815eac0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2460016070 con 0x7f246815eac0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2468159cc0 con 0x7f246815eac0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460011bf0 con 0x7f246815eac0 2024-04-13T02:45:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.145+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24680cd070 con 0x7f246815eac0 2024-04-13T02:45:45.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.146+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2468068c80 con 0x7f246815eac0 2024-04-13T02:45:45.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.146+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f246001b460 con 0x7f246815eac0 2024-04-13T02:45:45.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.147+0000 7f2456ffd640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f244806c8f0 0x7f244806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.147+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6104+0+0 (secure 0 0 0) 0x7f246008bae0 con 0x7f246815eac0 2024-04-13T02:45:45.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.147+0000 7f246659c640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f244806c8f0 0x7f244806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.147+0000 7f246659c640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f244806c8f0 0x7f244806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2458007fd0 tx=0x7f2458009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.151+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2460059cf0 con 0x7f246815eac0 2024-04-13T02:45:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.364+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2468159e90 con 0x7f246815eac0 2024-04-13T02:45:45.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.364+0000 7f2456ffd640 1 -- 172.21.15.114:0/1579514782 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7f24600595f0 con 0x7f246815eac0 2024-04-13T02:45:45.365 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:45.365 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:44.366275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:45.366 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 14 2024-04-13T02:45:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f244806c8f0 msgr2=0x7f244806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f244806c8f0 0x7f244806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2458007fd0 tx=0x7f2458009040 comp rx=0 tx=0).stop 2024-04-13T02:45:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 msgr2=0x7f24680b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 0x7f24680b7ef0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2460009fd0 tx=0x7f246000b8e0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 shutdown_connections 2024-04-13T02:45:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246815eac0 0x7f24680b7ef0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24680d1300 0x7f246815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f244806c8f0 0x7f244806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 --2- 172.21.15.114:0/1579514782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24680b3470 0x7f2468159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 >> 172.21.15.114:0/1579514782 conn(0x7f2468073690 msgr2=0x7f24680d3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 shutdown_connections 2024-04-13T02:45:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.366+0000 7f246ce60640 1 -- 172.21.15.114:0/1579514782 wait complete. 2024-04-13T02:45:45.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:45.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.477+0000 7f17af19c640 1 Processor -- start 2024-04-13T02:45:45.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.477+0000 7f17af19c640 1 -- start start 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17af19c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17a80b51f0 0x7f17a815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17af19c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a806f940 con 0x7f17a8070210 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17af19c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a806e8a0 con 0x7f17a815b6d0 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17af19c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f17a806eb80 con 0x7f17a80b51f0 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17ad739640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17a80b51f0 0x7f17a815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17ad739640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17a80b51f0 0x7f17a815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38148/0 (socket says 172.21.15.114:38148) 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17a7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f17a8070210 0x7f17a80b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52436/0 (socket says 172.21.15.114:52436) 2024-04-13T02:45:45.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17ad739640 1 -- 172.21.15.114:0/2515022217 learned_addr learned my addr 172.21.15.114:0/2515022217 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:45.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17ad739640 1 -- 172.21.15.114:0/2515022217 >> v1:172.21.15.130:6789/0 conn(0x7f17a815b6d0 legacy=0x7f17a80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17ad739640 1 -- 172.21.15.114:0/2515022217 >> v1:172.21.15.114:6789/0 conn(0x7f17a8070210 legacy=0x7f17a80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17ad739640 1 -- 172.21.15.114:0/2515022217 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a806ee60 con 0x7f17a80b51f0 2024-04-13T02:45:45.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.478+0000 7f17a77fe640 1 -- 172.21.15.114:0/2515022217 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991479715 0 0) 0x7f17a806f940 con 0x7f17a8070210 2024-04-13T02:45:45.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.479+0000 7f17ad739640 1 --2- 172.21.15.114:0/2515022217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a815cac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f17a000d150 tx=0x7f17a002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36571e2e49a181b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.479+0000 7f17a77fe640 1 -- 172.21.15.114:0/2515022217 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a000b0d0 con 0x7f17a80b51f0 2024-04-13T02:45:45.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.479+0000 7f17a77fe640 1 -- 172.21.15.114:0/2515022217 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a000b270 con 0x7f17a80b51f0 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.479+0000 7f17a77fe640 1 -- 172.21.15.114:0/2515022217 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a0009600 con 0x7f17a80b51f0 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.479+0000 7f17af19c640 1 -- 172.21.15.114:0/2515022217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 msgr2=0x7f17a815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.479+0000 7f17af19c640 1 --2- 172.21.15.114:0/2515022217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a815cac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f17a000d150 tx=0x7f17a002e170 comp rx=0 tx=0).stop 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.480+0000 7f17af19c640 1 -- 172.21.15.114:0/2515022217 shutdown_connections 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.480+0000 7f17af19c640 1 --2- 172.21.15.114:0/2515022217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a815cac0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.480+0000 7f17af19c640 1 -- 172.21.15.114:0/2515022217 >> 172.21.15.114:0/2515022217 conn(0x7f17a80b27b0 msgr2=0x7f17a80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.480+0000 7f17af19c640 1 -- 172.21.15.114:0/2515022217 shutdown_connections 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.480+0000 7f17af19c640 1 -- 172.21.15.114:0/2515022217 wait complete. 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.481+0000 7f17af19c640 1 Processor -- start 2024-04-13T02:45:45.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.481+0000 7f17af19c640 1 -- start start 2024-04-13T02:45:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17a8070210 0x7f17a8151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a81584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17a815b6d0 0x7f17a81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17a80ce420 con 0x7f17a80b51f0 2024-04-13T02:45:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f17a806f420 con 0x7f17a8070210 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f17a80b39d0 con 0x7f17a815b6d0 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a81584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a81584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38158/0 (socket says 172.21.15.114:38158) 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 -- 172.21.15.114:0/3414092304 learned_addr learned my addr 172.21.15.114:0/3414092304 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17acf38640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17a8070210 0x7f17a8151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17ad739640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17a815b6d0 0x7f17a81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 -- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17a815b6d0 msgr2=0x7f17a81589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17a815b6d0 0x7f17a81589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 -- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17a8070210 msgr2=0x7f17a8151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17a8070210 0x7f17a8151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 -- 172.21.15.114:0/3414092304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a8157b60 con 0x7f17a80b51f0 2024-04-13T02:45:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a7fff640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a81584b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f179400c4a0 tx=0x7f179400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794018070 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17940074e0 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a8156fe0 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794004a20 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.482+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a81575a0 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.483+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a80ac580 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.484+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f179401b070 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.484+0000 7f17a57fa640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f178c06c8f0 0x7f178c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.484+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6104+0+0 (secure 0 0 0) 0x7f179408af10 con 0x7f17a80b51f0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.484+0000 7f17acf38640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f178c06c8f0 0x7f178c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.485+0000 7f17acf38640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f178c06c8f0 0x7f178c06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f179c000f60 tx=0x7f179c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.488+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1794059240 con 0x7f17a80b51f0 2024-04-13T02:45:45.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.668+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17a8068c80 con 0x7f17a80b51f0 2024-04-13T02:45:45.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.669+0000 7f17a57fa640 1 -- 172.21.15.114:0/3414092304 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18530 (secure 0 0 0) 0x7f1794058b40 con 0x7f17a80b51f0 2024-04-13T02:45:45.670 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:45.671 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:45:44.366068+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-04-13T02:45:43.069443+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.671+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f178c06c8f0 msgr2=0x7f178c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.671+0000 7f17af19c640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f178c06c8f0 0x7f178c06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f179c000f60 tx=0x7f179c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.671+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 msgr2=0x7f17a81584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.671+0000 7f17af19c640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a81584b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f179400c4a0 tx=0x7f179400c960 comp rx=0 tx=0).stop 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 shutdown_connections 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f178c06c8f0 0x7f178c06edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17a815b6d0 0x7f17a81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a80b51f0 0x7f17a81584b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 --2- 172.21.15.114:0/3414092304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17a8070210 0x7f17a8151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 >> 172.21.15.114:0/3414092304 conn(0x7f17a80b27b0 msgr2=0x7f17a815c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:45.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 shutdown_connections 2024-04-13T02:45:45.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.672+0000 7f17af19c640 1 -- 172.21.15.114:0/3414092304 wait complete. 2024-04-13T02:45:45.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:45.684 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new ./parent_b/alpha) 2024-04-13T02:45:45.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:45:45.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.850+0000 7f9859c0f640 1 Processor -- start 2024-04-13T02:45:45.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.850+0000 7f9859c0f640 1 -- start start 2024-04-13T02:45:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9859c0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f985415b6d0 0x7f98540cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9859c0f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985406f940 con 0x7f98540b51f0 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9859c0f640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985406e8a0 con 0x7f9854070210 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9859c0f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f985406eb80 con 0x7f985415b6d0 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9853fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f98540b51f0 0x7f985415bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52444/0 (socket says 172.21.15.114:52444) 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9853fff640 1 -- 172.21.15.114:0/2962961971 learned_addr learned my addr 172.21.15.114:0/2962961971 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f98537fe640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f985415b6d0 0x7f98540cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911366911 0 0) 0x7f985406f940 con 0x7f98540b51f0 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.851+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9840003520 con 0x7f98540b51f0 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424605439 0 0) 0x7f985406e8a0 con 0x7f9854070210 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f985406f940 con 0x7f9854070210 2024-04-13T02:45:45.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2264882957 0 0) 0x7f9840003520 con 0x7f98540b51f0 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f985415b6d0 msgr2=0x7f98540cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f985415b6d0 0x7f98540cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 >> v1:172.21.15.130:6789/0 conn(0x7f9854070210 legacy=0x7f98540b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985406ee60 con 0x7f98540b51f0 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f984c0019f0 con 0x7f98540b51f0 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 >> v1:172.21.15.114:6789/0 conn(0x7f98540b51f0 legacy=0x7f985415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9840003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9840004800 0x7f9840004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98400051c0 0x7f984000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f985406eb80 con 0x7f9840003b70 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f984000c030 con 0x7f98400051c0 2024-04-13T02:45:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f984000c230 con 0x7f9840004800 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f985415b6d0 0x7f98540cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9840003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f9853fff640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98400051c0 0x7f984000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f984affd640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9840004800 0x7f9840004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 -- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9840004800 msgr2=0x7f9840004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9840004800 0x7f9840004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 -- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98400051c0 msgr2=0x7f984000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98400051c0 0x7f984000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.852+0000 7f98537fe640 1 -- 172.21.15.114:0/2962961971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9840003520 con 0x7f9840003b70 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.853+0000 7f98537fe640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9840003f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f985406e120 tx=0x7f9840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5d37bfd07a0f55 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.853+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98440097d0 con 0x7f9840003b70 2024-04-13T02:45:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.853+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844004030 con 0x7f9840003b70 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.853+0000 7f9852ffd640 1 -- 172.21.15.114:0/2962961971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844004400 con 0x7f9840003b70 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9859c0f640 1 -- 172.21.15.114:0/2962961971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 msgr2=0x7f9840003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9859c0f640 1 --2- 172.21.15.114:0/2962961971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9840003f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f985406e120 tx=0x7f9840005830 comp rx=0 tx=0).stop 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9853fff640 1 -- 172.21.15.114:0/2962961971 reap_dead start 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9859c0f640 1 -- 172.21.15.114:0/2962961971 shutdown_connections 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9859c0f640 1 -- 172.21.15.114:0/2962961971 >> 172.21.15.114:0/2962961971 conn(0x7f98540b27b0 msgr2=0x7f98540b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9859c0f640 1 -- 172.21.15.114:0/2962961971 shutdown_connections 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.854+0000 7f9859c0f640 1 -- 172.21.15.114:0/2962961971 wait complete. 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.855+0000 7f9859c0f640 1 Processor -- start 2024-04-13T02:45:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.855+0000 7f9859c0f640 1 -- start start 2024-04-13T02:45:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9854146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9854152600 0x7f98540b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98540b1bc0 0x7f985414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f98540cdd10 con 0x7f9840003b70 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f985406f420 con 0x7f98540b1bc0 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f98540cde90 con 0x7f9854152600 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9854146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9854146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38176/0 (socket says 172.21.15.114:38176) 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 -- 172.21.15.114:0/3124773147 learned_addr learned my addr 172.21.15.114:0/3124773147 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9853fff640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98540b1bc0 0x7f985414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f984affd640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9854152600 0x7f98540b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 -- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9854152600 msgr2=0x7f98540b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9854152600 0x7f98540b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 -- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98540b1bc0 msgr2=0x7f985414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98540b1bc0 0x7f985414aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 -- 172.21.15.114:0/3124773147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98541531b0 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9853fff640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98540b1bc0 0x7f985414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f98537fe640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9854146480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9844009bf0 tx=0x7f9844004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844042070 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984402c910 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9854153490 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984402ccc0 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.856+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98541469c0 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.857+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9854068c80 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.858+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9844045070 con 0x7f9840003b70 2024-04-13T02:45:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.858+0000 7f9850ff9640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f983406c8f0 0x7f983406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.858+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6104+0+0 (secure 0 0 0) 0x7f98440adc20 con 0x7f9840003b70 2024-04-13T02:45:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.858+0000 7f984affd640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f983406c8f0 0x7f983406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.859+0000 7f984affd640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f983406c8f0 0x7f983406edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f98541f60c0 tx=0x7f983c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:45.863+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f984407c070 con 0x7f9840003b70 2024-04-13T02:45:46.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.078+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98540af730 con 0x7f9840003b70 2024-04-13T02:45:46.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.078+0000 7f9850ff9640 1 -- 172.21.15.114:0/3124773147 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5192 (secure 0 0 0) 0x7f984407b970 con 0x7f9840003b70 2024-04-13T02:45:46.079 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:46.079 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5079,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:45:44.366275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2419206521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2419206521},{"type":"v1","addr":"172.21.15.114:6837","nonce":2419206521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5082,"qdb_cluster":[5082]},"id":2}]} 2024-04-13T02:45:46.079 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 14 2024-04-13T02:45:46.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f983406c8f0 msgr2=0x7f983406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f983406c8f0 0x7f983406edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f98541f60c0 tx=0x7f983c009040 comp rx=0 tx=0).stop 2024-04-13T02:45:46.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 msgr2=0x7f9854146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9854146480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9844009bf0 tx=0x7f9844004730 comp rx=0 tx=0).stop 2024-04-13T02:45:46.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 shutdown_connections 2024-04-13T02:45:46.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98540b1bc0 0x7f985414aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f983406c8f0 0x7f983406edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9854152600 0x7f98540b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 --2- 172.21.15.114:0/3124773147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9840003b70 0x7f9854146480 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 >> 172.21.15.114:0/3124773147 conn(0x7f98540b27b0 msgr2=0x7f98540b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:46.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 shutdown_connections 2024-04-13T02:45:46.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.080+0000 7f9859c0f640 1 -- 172.21.15.114:0/3124773147 wait complete. 2024-04-13T02:45:46.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-13T02:45:46.204 INFO:tasks.ceph.mds.a.smithi114.stdout:/usr/include/c++/11/bits/stl_vector.h:1145: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::back() [with _Tp = CInodeCommitOperations; _Alloc = std::allocator; std::vector<_Tp, _Alloc>::reference = CInodeCommitOperations&]: Assertion '!this->empty()' failed. 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr:*** Caught signal (Aborted) ** 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f980fde9640 thread_name:MR_Finisher 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f981ba54db0] 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f981baa154c] 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: ceph-mds(+0x14db08) [0x556cbc06eb08] 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x556cbc0e59b0] 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x556cbc363b62] 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDLog::trim_all()+0x769) [0x556cbc368799] 2024-04-13T02:45:46.205 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: ceph-mds(+0x1b2411) [0x556cbc0d3411] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: ceph-mds(+0x15491d) [0x556cbc07591d] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: ceph-mds(+0x154be2) [0x556cbc075be2] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x556cbc35d9ac] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: (Finisher::finisher_thread_entry()+0x175) [0x7f981c430465] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 16: /lib64/libc.so.6(+0x9f802) [0x7f981ba9f802] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 17: /lib64/libc.so.6(+0x3f450) [0x7f981ba3f450] 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-04-13T02:45:46.204+0000 7f980fde9640 -1 *** Caught signal (Aborted) ** 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f980fde9640 thread_name:MR_Finisher 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-13T02:45:46.206 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f981ba54db0] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f981baa154c] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: ceph-mds(+0x14db08) [0x556cbc06eb08] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x556cbc0e59b0] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x556cbc363b62] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDLog::trim_all()+0x769) [0x556cbc368799] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: ceph-mds(+0x1b2411) [0x556cbc0d3411] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: ceph-mds(+0x15491d) [0x556cbc07591d] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: ceph-mds(+0x154be2) [0x556cbc075be2] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x556cbc35d9ac] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: (Finisher::finisher_thread_entry()+0x175) [0x7f981c430465] 2024-04-13T02:45:46.207 INFO:tasks.ceph.mds.a.smithi114.stderr: 16: /lib64/libc.so.6(+0x9f802) [0x7f981ba9f802] 2024-04-13T02:45:46.208 INFO:tasks.ceph.mds.a.smithi114.stderr: 17: /lib64/libc.so.6(+0x3f450) [0x7f981ba3f450] 2024-04-13T02:45:46.208 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-13T02:45:46.208 INFO:tasks.ceph.mds.a.smithi114.stderr: 2024-04-13T02:45:46.210 INFO:tasks.ceph.mds.a.smithi114.stderr: -6839> 2024-04-13T02:45:32.412+0000 7f9813df1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2024-04-13T02:45:46.204+0000 7f980fde9640 -1 *** Caught signal (Aborted) ** 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f980fde9640 thread_name:MR_Finisher 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f981ba54db0] 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f981baa154c] 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2024-04-13T02:45:46.216 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: ceph-mds(+0x14db08) [0x556cbc06eb08] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x556cbc0e59b0] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x556cbc363b62] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDLog::trim_all()+0x769) [0x556cbc368799] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: ceph-mds(+0x1b2411) [0x556cbc0d3411] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: ceph-mds(+0x15491d) [0x556cbc07591d] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: ceph-mds(+0x154be2) [0x556cbc075be2] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x556cbc35d9ac] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: (Finisher::finisher_thread_entry()+0x175) [0x7f981c430465] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 16: /lib64/libc.so.6(+0x9f802) [0x7f981ba9f802] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 17: /lib64/libc.so.6(+0x3f450) [0x7f981ba3f450] 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-13T02:45:46.217 INFO:tasks.ceph.mds.a.smithi114.stderr: 2024-04-13T02:45:46.218 INFO:tasks.ceph.mds.a.smithi114.stderr: -6842> 2024-04-13T02:45:32.412+0000 7f9813df1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:45:46.223 INFO:tasks.ceph.mds.a.smithi114.stderr: -3> 2024-04-13T02:45:46.204+0000 7f980fde9640 -1 *** Caught signal (Aborted) ** 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f980fde9640 thread_name:MR_Finisher 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f981ba54db0] 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f981baa154c] 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: ceph-mds(+0x14db08) [0x556cbc06eb08] 2024-04-13T02:45:46.224 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x556cbc0e59b0] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x556cbc363b62] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDLog::trim_all()+0x769) [0x556cbc368799] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: ceph-mds(+0x1b2411) [0x556cbc0d3411] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: ceph-mds(+0x15491d) [0x556cbc07591d] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: ceph-mds(+0x154be2) [0x556cbc075be2] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: (MDSContext::complete(int)+0x5c) [0x556cbc35d55c] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: (MDSIOContextBase::complete(int)+0x31c) [0x556cbc35d9ac] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: (Finisher::finisher_thread_entry()+0x175) [0x7f981c430465] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 16: /lib64/libc.so.6(+0x9f802) [0x7f981ba9f802] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: 17: /lib64/libc.so.6(+0x3f450) [0x7f981ba3f450] 2024-04-13T02:45:46.225 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-13T02:45:46.226 INFO:tasks.ceph.mds.a.smithi114.stderr: 2024-04-13T02:45:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:admin_socket: exception: exception: no data returned from admin socket 2024-04-13T02:45:46.254 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-13T02:45:46.255 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-13T02:45:46.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-13T02:45:46.305 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-13T02:45:46.357 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-13T02:45:46.357 INFO:tasks.cephfs.mount:Terminating background process 2024-04-13T02:45:46.357 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:46.357 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:46.373 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:45:46.373 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:45:46.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:45:46.567 INFO:tasks.ceph.mds.a.smithi114.stderr:daemon-helper: command crashed with signal 6 2024-04-13T02:45:46.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 Processor -- start 2024-04-13T02:45:46.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 -- start start 2024-04-13T02:45:46.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e2c0d1300 0x7f0e2c0d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c0b3470 0x7f0e2c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2c0d2d90 con 0x7f0e2c15eac0 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f0e2c0d1cd0 con 0x7f0e2c0d1300 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.568+0000 7f0e31236640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2c0d3070 con 0x7f0e2c0b3470 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e2c0d1300 0x7f0e2c0d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e2c0d1300 0x7f0e2c0d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38192/0 (socket says 172.21.15.114:38192) 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 -- 172.21.15.114:0/2077426652 learned_addr learned my addr 172.21.15.114:0/2077426652 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 -- 172.21.15.114:0/2077426652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c0b3470 msgr2=0x7f0e2c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 --2- 172.21.15.114:0/2077426652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c0b3470 0x7f0e2c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 -- 172.21.15.114:0/2077426652 >> v1:172.21.15.130:6789/0 conn(0x7f0e2c15eac0 legacy=0x7f0e2c0d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:46.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.569+0000 7f0e2a59c640 1 -- 172.21.15.114:0/2077426652 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c0d3350 con 0x7f0e2c0d1300 2024-04-13T02:45:46.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e2a59c640 1 --2- 172.21.15.114:0/2077426652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0d1790 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009870 tx=0x7f0e2002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a08a9e9557d215 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:46.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e29d9b640 1 -- 172.21.15.114:0/2077426652 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035020 con 0x7f0e2c0d1300 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e29d9b640 1 -- 172.21.15.114:0/2077426652 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e20031640 con 0x7f0e2c0d1300 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e29d9b640 1 -- 172.21.15.114:0/2077426652 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2002d040 con 0x7f0e2c0d1300 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 -- 172.21.15.114:0/2077426652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0d1300 msgr2=0x7f0e2c0d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 --2- 172.21.15.114:0/2077426652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0d1790 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009870 tx=0x7f0e2002b8f0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 -- 172.21.15.114:0/2077426652 shutdown_connections 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 --2- 172.21.15.114:0/2077426652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c0b3470 0x7f0e2c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 --2- 172.21.15.114:0/2077426652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0d1790 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 -- 172.21.15.114:0/2077426652 >> 172.21.15.114:0/2077426652 conn(0x7f0e2c073690 msgr2=0x7f0e2c06cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.570+0000 7f0e31236640 1 -- 172.21.15.114:0/2077426652 shutdown_connections 2024-04-13T02:45:46.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.571+0000 7f0e31236640 1 -- 172.21.15.114:0/2077426652 wait complete. 2024-04-13T02:45:46.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.572+0000 7f0e31236640 1 Processor -- start 2024-04-13T02:45:46.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.572+0000 7f0e31236640 1 -- start start 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e31236640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 0x7f0e2c1f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e31236640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e31236640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c15eac0 0x7f0e2c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e31236640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c15eea0 con 0x7f0e2c0b3470 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e31236640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c0d3910 con 0x7f0e2c0d1300 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e31236640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2c0d4590 con 0x7f0e2c15eac0 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 0x7f0e2c1f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 0x7f0e2c1f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38202/0 (socket says 172.21.15.114:38202) 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 -- 172.21.15.114:0/879073786 learned_addr learned my addr 172.21.15.114:0/879073786 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:46.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2a59c640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2b59e640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c15eac0 0x7f0e2c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 -- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c15eac0 msgr2=0x7f0e2c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c15eac0 0x7f0e2c15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 -- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e2c0d1300 msgr2=0x7f0e2c0b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 -- 172.21.15.114:0/879073786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c1f56d0 con 0x7f0e2c0b3470 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2b59e640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c15eac0 0x7f0e2c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e2ad9d640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 0x7f0e2c1f5190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b3f0 tx=0x7f0e1c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.573+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c015020 con 0x7f0e2c0b3470 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.574+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c011830 con 0x7f0e2c0b3470 2024-04-13T02:45:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.574+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011c20 con 0x7f0e2c0b3470 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.574+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c15ab00 con 0x7f0e2c0b3470 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.574+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c15adc0 con 0x7f0e2c0b3470 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.575+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2c068c80 con 0x7f0e2c0b3470 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.575+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e1c018020 con 0x7f0e2c0b3470 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.575+0000 7f0e137fe640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e1806c8f0 0x7f0e1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.576+0000 7f0e2a59c640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e1806c8f0 0x7f0e1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.576+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f0e1c08b7f0 con 0x7f0e2c0b3470 2024-04-13T02:45:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.576+0000 7f0e2a59c640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e1806c8f0 0x7f0e1806edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e20036000 tx=0x7f0e2003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:46.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.580+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e1c01f030 con 0x7f0e2c0b3470 2024-04-13T02:45:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.755+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e2c0b7020 con 0x7f0e2c0b3470 2024-04-13T02:45:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.756+0000 7f0e137fe640 1 -- 172.21.15.114:0/879073786 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+18517 (secure 0 0 0) 0x7f0e2c1f56d0 con 0x7f0e2c0b3470 2024-04-13T02:45:46.757 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:45:46.757 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:45:46.011774+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-04-13T02:45:43.069443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:45:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e1806c8f0 msgr2=0x7f0e1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e1806c8f0 0x7f0e1806edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e20036000 tx=0x7f0e2003c040 comp rx=0 tx=0).stop 2024-04-13T02:45:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 msgr2=0x7f0e2c1f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 0x7f0e2c1f5190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b3f0 tx=0x7f0e1c00b8b0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 shutdown_connections 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e1806c8f0 0x7f0e1806edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e2c15eac0 0x7f0e2c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e2c0d1300 0x7f0e2c0b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 --2- 172.21.15.114:0/879073786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e2c0b3470 0x7f0e2c1f5190 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 >> 172.21.15.114:0/879073786 conn(0x7f0e2c073690 msgr2=0x7f0e2c0c8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 shutdown_connections 2024-04-13T02:45:46.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.758+0000 7f0e31236640 1 -- 172.21.15.114:0/879073786 wait complete. 2024-04-13T02:45:46.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:45:26.236118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:45:26.746769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-04-13T02:45:43.069443+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:45:46.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:45:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.914+0000 7f3e280c0640 1 Processor -- start 2024-04-13T02:45:46.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.914+0000 7f3e280c0640 1 -- start start 2024-04-13T02:45:46.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e280c0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e2015d0e0 0x7f3e200cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e280c0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e200ce4c0 0x7f3e2015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e280c0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2006f890 con 0x7f3e2015da00 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e280c0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f3e200ce030 con 0x7f3e200ce4c0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e280c0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3e20067e90 con 0x7f3e2015d0e0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e200ce4c0 0x7f3e2015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e200ce4c0 0x7f3e2015d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38212/0 (socket says 172.21.15.114:38212) 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 -- 172.21.15.114:0/1285290207 learned_addr learned my addr 172.21.15.114:0/1285290207 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e25e5c640 1 --2- 172.21.15.114:0/1285290207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e2015d0e0 0x7f3e200cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 -- 172.21.15.114:0/1285290207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e2015d0e0 msgr2=0x7f3e200cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 --2- 172.21.15.114:0/1285290207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e2015d0e0 0x7f3e200cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 -- 172.21.15.114:0/1285290207 >> v1:172.21.15.130:6789/0 conn(0x7f3e2015da00 legacy=0x7f3e2006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.915+0000 7f3e2565b640 1 -- 172.21.15.114:0/1285290207 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e20068170 con 0x7f3e200ce4c0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.916+0000 7f3e2565b640 1 --2- 172.21.15.114:0/1285290207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e200ce4c0 0x7f3e2015d4c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009870 tx=0x7f3e1002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22d3d61a7806d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.916+0000 7f3e24e5a640 1 -- 172.21.15.114:0/1285290207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10034070 con 0x7f3e200ce4c0 2024-04-13T02:45:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.916+0000 7f3e24e5a640 1 -- 172.21.15.114:0/1285290207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e10030840 con 0x7f3e200ce4c0 2024-04-13T02:45:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.916+0000 7f3e24e5a640 1 -- 172.21.15.114:0/1285290207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10030c10 con 0x7f3e200ce4c0 2024-04-13T02:45:46.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.916+0000 7f3e280c0640 1 -- 172.21.15.114:0/1285290207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e200ce4c0 msgr2=0x7f3e2015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.916+0000 7f3e280c0640 1 --2- 172.21.15.114:0/1285290207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e200ce4c0 0x7f3e2015d4c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009870 tx=0x7f3e1002b980 comp rx=0 tx=0).stop 2024-04-13T02:45:46.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.917+0000 7f3e280c0640 1 -- 172.21.15.114:0/1285290207 shutdown_connections 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.917+0000 7f3e280c0640 1 --2- 172.21.15.114:0/1285290207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e200ce4c0 0x7f3e2015d4c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.917+0000 7f3e280c0640 1 --2- 172.21.15.114:0/1285290207 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e2015d0e0 0x7f3e200cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.917+0000 7f3e280c0640 1 -- 172.21.15.114:0/1285290207 >> 172.21.15.114:0/1285290207 conn(0x7f3e2006ea10 msgr2=0x7f3e2006ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.917+0000 7f3e280c0640 1 -- 172.21.15.114:0/1285290207 shutdown_connections 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.917+0000 7f3e280c0640 1 -- 172.21.15.114:0/1285290207 wait complete. 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 Processor -- start 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 -- start start 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e200ce4c0 0x7f3e2015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e2015d0e0 0x7f3e2013d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 0x7f3e20140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e200cfe30 con 0x7f3e2015da00 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3e200cdcc0 con 0x7f3e2015d0e0 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.918+0000 7f3e280c0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3e200ce940 con 0x7f3e200ce4c0 2024-04-13T02:45:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 0x7f3e20140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 0x7f3e20140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38220/0 (socket says 172.21.15.114:38220) 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 -- 172.21.15.114:0/850148928 learned_addr learned my addr 172.21.15.114:0/850148928 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2565b640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e2015d0e0 0x7f3e2013d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e25e5c640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e200ce4c0 0x7f3e2015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 -- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e200ce4c0 msgr2=0x7f3e2015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e200ce4c0 0x7f3e2015bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 -- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e2015d0e0 msgr2=0x7f3e2013d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e2015d0e0 0x7f3e2013d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 -- 172.21.15.114:0/850148928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2013dde0 con 0x7f3e2015da00 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2565b640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e2015d0e0 0x7f3e2013d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e2665d640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 0x7f3e20140210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800c680 tx=0x7f3e1800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18003b70 con 0x7f3e2015da00 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e18003d10 con 0x7f3e2015da00 2024-04-13T02:45:46.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2013e0c0 con 0x7f3e2015da00 2024-04-13T02:45:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18005310 con 0x7f3e2015da00 2024-04-13T02:45:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.919+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2013e680 con 0x7f3e2015da00 2024-04-13T02:45:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.920+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e20070fe0 con 0x7f3e2015da00 2024-04-13T02:45:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.921+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e180054b0 con 0x7f3e2015da00 2024-04-13T02:45:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.921+0000 7f3e167fc640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3e0406c8f0 0x7f3e0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.921+0000 7f3e25e5c640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3e0406c8f0 0x7f3e0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.921+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f3e1808ba90 con 0x7f3e2015da00 2024-04-13T02:45:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.922+0000 7f3e25e5c640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3e0406c8f0 0x7f3e0406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009a10 tx=0x7f3e1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:46.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:46.926+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e20070fe0 con 0x7f3e2015da00 2024-04-13T02:45:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.100+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e20068c80 con 0x7f3e2015da00 2024-04-13T02:45:47.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.100+0000 7f3e167fc640 1 -- 172.21.15.114:0/850148928 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f3e18059dc0 con 0x7f3e2015da00 2024-04-13T02:45:47.101 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3e0406c8f0 msgr2=0x7f3e0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3e0406c8f0 0x7f3e0406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009a10 tx=0x7f3e1c008040 comp rx=0 tx=0).stop 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 msgr2=0x7f3e20140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 0x7f3e20140210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800c680 tx=0x7f3e1800cb40 comp rx=0 tx=0).stop 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 shutdown_connections 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e2015da00 0x7f3e20140210 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e2015d0e0 0x7f3e2013d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f3e0406c8f0 0x7f3e0406edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 --2- 172.21.15.114:0/850148928 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3e200ce4c0 0x7f3e2015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 >> 172.21.15.114:0/850148928 conn(0x7f3e2006ea10 msgr2=0x7f3e200afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:47.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 shutdown_connections 2024-04-13T02:45:47.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.102+0000 7f3e280c0640 1 -- 172.21.15.114:0/850148928 wait complete. 2024-04-13T02:45:47.114 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:45:47.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.216+0000 7fe205436640 1 Processor -- start 2024-04-13T02:45:47.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.216+0000 7fe205436640 1 -- start start 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe205436640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe20015c600 0x7fe20015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe205436640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe20009b940 0x7fe20009ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe205436640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe200160060 con 0x7fe20009b060 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe205436640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fe20009b4d0 con 0x7fe20015c600 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe205436640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe20006ca40 con 0x7fe20009b940 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1feffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe20015c600 0x7fe20015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1feffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe20015c600 0x7fe20015fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38230/0 (socket says 172.21.15.114:38230) 2024-04-13T02:45:47.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1ff7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe20009b060 0x7fe200070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52460/0 (socket says 172.21.15.114:52460) 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1feffd640 1 -- 172.21.15.114:0/2359757493 learned_addr learned my addr 172.21.15.114:0/2359757493 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1f7fff640 1 --2- 172.21.15.114:0/2359757493 >> v2:172.21.15.130:3300/0 conn(0x7fe20009b940 0x7fe20009ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1feffd640 1 -- 172.21.15.114:0/2359757493 >> v2:172.21.15.130:3300/0 conn(0x7fe20009b940 msgr2=0x7fe20009ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1feffd640 1 --2- 172.21.15.114:0/2359757493 >> v2:172.21.15.130:3300/0 conn(0x7fe20009b940 0x7fe20009ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1feffd640 1 -- 172.21.15.114:0/2359757493 >> v1:172.21.15.114:6789/0 conn(0x7fe20009b060 legacy=0x7fe200070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.217+0000 7fe1fe7fc640 1 -- 172.21.15.114:0/2359757493 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591919284 0 0) 0x7fe1f8001490 con 0x7fe20009b060 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.218+0000 7fe1feffd640 1 -- 172.21.15.114:0/2359757493 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2001628e0 con 0x7fe20015c600 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.218+0000 7fe1f7fff640 1 --2- 172.21.15.114:0/2359757493 >> v2:172.21.15.130:3300/0 conn(0x7fe20009b940 0x7fe20009ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.218+0000 7fe1feffd640 1 --2- 172.21.15.114:0/2359757493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20015c600 0x7fe20015fb20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe2000d3840 tx=0x7fe1f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1137ff7021e679b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.218+0000 7fe1fe7fc640 1 -- 172.21.15.114:0/2359757493 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0034070 con 0x7fe20015c600 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.218+0000 7fe1fe7fc640 1 -- 172.21.15.114:0/2359757493 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f0030860 con 0x7fe20015c600 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.218+0000 7fe1fe7fc640 1 -- 172.21.15.114:0/2359757493 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0030c30 con 0x7fe20015c600 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 -- 172.21.15.114:0/2359757493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20015c600 msgr2=0x7fe20015fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 --2- 172.21.15.114:0/2359757493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20015c600 0x7fe20015fb20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe2000d3840 tx=0x7fe1f002b9a0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 -- 172.21.15.114:0/2359757493 shutdown_connections 2024-04-13T02:45:47.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 --2- 172.21.15.114:0/2359757493 >> v2:172.21.15.130:3300/0 conn(0x7fe20009b940 0x7fe20009ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 --2- 172.21.15.114:0/2359757493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20015c600 0x7fe20015fb20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 -- 172.21.15.114:0/2359757493 >> 172.21.15.114:0/2359757493 conn(0x7fe2000d2740 msgr2=0x7fe2000d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:47.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 -- 172.21.15.114:0/2359757493 shutdown_connections 2024-04-13T02:45:47.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.219+0000 7fe205436640 1 -- 172.21.15.114:0/2359757493 wait complete. 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.220+0000 7fe205436640 1 Processor -- start 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.220+0000 7fe205436640 1 -- start start 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe205436640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe20009b060 0x7fe20014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe205436640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 0x7fe2000c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe205436640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20015c600 0x7fe2000703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe205436640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe200162690 con 0x7fe20009b940 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe205436640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe200162ea0 con 0x7fe20015c600 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe205436640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe200163180 con 0x7fe20009b060 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 0x7fe2000c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 0x7fe2000c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38244/0 (socket says 172.21.15.114:38244) 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 -- 172.21.15.114:0/2720382749 learned_addr learned my addr 172.21.15.114:0/2720382749 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:47.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1ff7fe640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20015c600 0x7fe2000703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1feffd640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe20009b060 0x7fe20014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 -- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe20009b060 msgr2=0x7fe20014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe20009b060 0x7fe20014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 -- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20015c600 msgr2=0x7fe2000703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20015c600 0x7fe2000703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 -- 172.21.15.114:0/2720382749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2000b1400 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.221+0000 7fe1f7fff640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 0x7fe2000c6240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800c7f0 tx=0x7fe1e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.222+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8015070 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.222+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e8007a30 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.222+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2000c8aa0 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.222+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8007e00 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.222+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2000c6780 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.223+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe200068c80 con 0x7fe20009b940 2024-04-13T02:45:47.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.223+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1e8018070 con 0x7fe20009b940 2024-04-13T02:45:47.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.223+0000 7fe1f77fe640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1e006c8f0 0x7fe1e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.223+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7fe1e808bc40 con 0x7fe20009b940 2024-04-13T02:45:47.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.223+0000 7fe1feffd640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1e006c8f0 0x7fe1e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.224+0000 7fe1feffd640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1e006c8f0 0x7fe1e006edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0036000 tx=0x7fe1f003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.228+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1e8059890 con 0x7fe20009b940 2024-04-13T02:45:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.404+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe2000714e0 con 0x7fe20009b940 2024-04-13T02:45:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.404+0000 7fe1f77fe640 1 -- 172.21.15.114:0/2720382749 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7fe1e805db90 con 0x7fe20009b940 2024-04-13T02:45:47.406 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1e006c8f0 msgr2=0x7fe1e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1e006c8f0 0x7fe1e006edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0036000 tx=0x7fe1f003c040 comp rx=0 tx=0).stop 2024-04-13T02:45:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 msgr2=0x7fe2000c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 0x7fe2000c6240 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800c7f0 tx=0x7fe1e800cbf0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 shutdown_connections 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe20015c600 0x7fe2000703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe20009b940 0x7fe2000c6240 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe1e006c8f0 0x7fe1e006edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 --2- 172.21.15.114:0/2720382749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe20009b060 0x7fe20014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 >> 172.21.15.114:0/2720382749 conn(0x7fe2000d2740 msgr2=0x7fe2000b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 shutdown_connections 2024-04-13T02:45:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.406+0000 7fe205436640 1 -- 172.21.15.114:0/2720382749 wait complete. 2024-04-13T02:45:47.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:45:47.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.522+0000 7f866c0d5640 1 Processor -- start 2024-04-13T02:45:47.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.522+0000 7f866c0d5640 1 -- start start 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866c0d5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f866415c600 0x7f866415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866c0d5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f866409b940 0x7f866409ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866c0d5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866c0d5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f866406ca40 con 0x7f866409b940 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866c0d5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f86641634f0 con 0x7f866415c600 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866c0d5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8664162690 con 0x7f866409b060 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f866409b940 0x7f866409ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f866409b940 0x7f866409ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38260/0 (socket says 172.21.15.114:38260) 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 -- 172.21.15.114:0/1279209161 learned_addr learned my addr 172.21.15.114:0/1279209161 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669e71640 1 --2- 172.21.15.114:0/1279209161 >> v2:172.21.15.130:3300/0 conn(0x7f866415c600 0x7f866415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866a672640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 -- 172.21.15.114:0/1279209161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 msgr2=0x7f8664070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 -- 172.21.15.114:0/1279209161 >> v2:172.21.15.130:3300/0 conn(0x7f866415c600 msgr2=0x7f866415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 --2- 172.21.15.114:0/1279209161 >> v2:172.21.15.130:3300/0 conn(0x7f866415c600 0x7f866415fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f8669670640 1 -- 172.21.15.114:0/1279209161 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664160060 con 0x7f866409b940 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.523+0000 7f866a672640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.524+0000 7f8669670640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f866409ab20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f86640c6240 tx=0x7f865402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d4446dbc639951 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.524+0000 7f8668e6f640 1 -- 172.21.15.114:0/1279209161 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654035020 con 0x7f866409b940 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.524+0000 7f8668e6f640 1 -- 172.21.15.114:0/1279209161 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8654031870 con 0x7f866409b940 2024-04-13T02:45:47.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.524+0000 7f8668e6f640 1 -- 172.21.15.114:0/1279209161 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654031c40 con 0x7f866409b940 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 -- 172.21.15.114:0/1279209161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 msgr2=0x7f866409ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f866409ab20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f86640c6240 tx=0x7f865402b910 comp rx=0 tx=0).stop 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 -- 172.21.15.114:0/1279209161 shutdown_connections 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 --2- 172.21.15.114:0/1279209161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f866409ab20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 --2- 172.21.15.114:0/1279209161 >> v2:172.21.15.130:3300/0 conn(0x7f866415c600 0x7f866415fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 -- 172.21.15.114:0/1279209161 >> 172.21.15.114:0/1279209161 conn(0x7f86640d2740 msgr2=0x7f86640d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 -- 172.21.15.114:0/1279209161 shutdown_connections 2024-04-13T02:45:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.525+0000 7f866c0d5640 1 -- 172.21.15.114:0/1279209161 wait complete. 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.526+0000 7f866c0d5640 1 Processor -- start 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.526+0000 7f866c0d5640 1 -- start start 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f86640b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f866415c600 0x7f86640b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8664162ea0 con 0x7f866409b940 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8664162bc0 con 0x7f866415c600 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8664163180 con 0x7f866409b060 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f86640b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f86640b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38270/0 (socket says 172.21.15.114:38270) 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 -- 172.21.15.114:0/3594390756 learned_addr learned my addr 172.21.15.114:0/3594390756 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669e71640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866a672640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f866415c600 0x7f86640b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 -- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 msgr2=0x7f8664148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 -- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f866415c600 msgr2=0x7f86640b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f866415c600 0x7f86640b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 -- 172.21.15.114:0/3594390756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664148aa0 con 0x7f866409b940 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f8669670640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f86640b06f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f865402b950 tx=0x7f86540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654040070 con 0x7f866409b940 2024-04-13T02:45:47.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8654030d00 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86641f49d0 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654035040 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.527+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866415ec80 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.528+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8664068c80 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.529+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8654038020 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.529+0000 7f865a7fc640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.529+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f86540ad9e0 con 0x7f866409b940 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.529+0000 7f8669e71640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.529+0000 7f8669e71640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8664145990 tx=0x7f8660009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.533+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8664148aa0 con 0x7f866409b940 2024-04-13T02:45:47.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.710+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f86640704e0 con 0x7f866409b940 2024-04-13T02:45:47.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.710+0000 7f865a7fc640 1 -- 172.21.15.114:0/3594390756 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f8664160060 con 0x7f866409b940 2024-04-13T02:45:47.711 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:45:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f864806c8f0 msgr2=0x7f864806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8664145990 tx=0x7f8660009190 comp rx=0 tx=0).stop 2024-04-13T02:45:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 msgr2=0x7f86640b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f86640b06f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f865402b950 tx=0x7f86540046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 shutdown_connections 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f866415c600 0x7f86640b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f866409b940 0x7f86640b06f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 --2- 172.21.15.114:0/3594390756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f866409b060 0x7f8664148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 >> 172.21.15.114:0/3594390756 conn(0x7f86640d2740 msgr2=0x7f86640cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 shutdown_connections 2024-04-13T02:45:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.712+0000 7f866c0d5640 1 -- 172.21.15.114:0/3594390756 wait complete. 2024-04-13T02:45:47.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-04-13T02:45:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.827+0000 7fb40a0a2640 1 Processor -- start 2024-04-13T02:45:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.827+0000 7fb40a0a2640 1 -- start start 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb40a0a2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40415a440 0x7fb40415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb40a0a2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb40406fc80 0x7fb4040cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb40a0a2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb4040cd620 0x7fb404072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb40a0a2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fb40406e280 con 0x7fb40406fc80 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb40a0a2640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb40415d520 con 0x7fb4040cd620 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb40a0a2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb40415d800 con 0x7fb40415a440 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb40406fc80 0x7fb4040cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb40406fc80 0x7fb4040cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38274/0 (socket says 172.21.15.114:38274) 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 -- 172.21.15.114:0/770966802 learned_addr learned my addr 172.21.15.114:0/770966802 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 -- 172.21.15.114:0/770966802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40415a440 msgr2=0x7fb40415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb403fff640 1 --2- 172.21.15.114:0/770966802 >> v2:172.21.15.130:3300/0 conn(0x7fb4040cd620 0x7fb404072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb4037fe640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40415a440 0x7fb40415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40415a440 0x7fb40415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 -- 172.21.15.114:0/770966802 >> v2:172.21.15.130:3300/0 conn(0x7fb4040cd620 msgr2=0x7fb404072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 --2- 172.21.15.114:0/770966802 >> v2:172.21.15.130:3300/0 conn(0x7fb4040cd620 0x7fb404072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb402ffd640 1 -- 172.21.15.114:0/770966802 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40415dae0 con 0x7fb40406fc80 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb403fff640 1 --2- 172.21.15.114:0/770966802 >> v2:172.21.15.130:3300/0 conn(0x7fb4040cd620 0x7fb404072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.828+0000 7fb4037fe640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40415a440 0x7fb40415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.829+0000 7fb402ffd640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40406fc80 0x7fb4040cd0e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb4040ccb70 tx=0x7fb3f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aed57885c67dce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.829+0000 7fb4027fc640 1 -- 172.21.15.114:0/770966802 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8035020 con 0x7fb40406fc80 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.829+0000 7fb4027fc640 1 -- 172.21.15.114:0/770966802 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f8031870 con 0x7fb40406fc80 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.829+0000 7fb4027fc640 1 -- 172.21.15.114:0/770966802 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8031c40 con 0x7fb40406fc80 2024-04-13T02:45:47.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.829+0000 7fb40a0a2640 1 -- 172.21.15.114:0/770966802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40406fc80 msgr2=0x7fb4040cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.829+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40406fc80 0x7fb4040cd0e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb4040ccb70 tx=0x7fb3f802b910 comp rx=0 tx=0).stop 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 -- 172.21.15.114:0/770966802 shutdown_connections 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/770966802 >> v2:172.21.15.130:3300/0 conn(0x7fb4040cd620 0x7fb404072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40406fc80 0x7fb4040cd0e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/770966802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40415a440 0x7fb40415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 -- 172.21.15.114:0/770966802 >> 172.21.15.114:0/770966802 conn(0x7fb4040b2460 msgr2=0x7fb4040b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 -- 172.21.15.114:0/770966802 shutdown_connections 2024-04-13T02:45:47.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.830+0000 7fb40a0a2640 1 -- 172.21.15.114:0/770966802 wait complete. 2024-04-13T02:45:47.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.831+0000 7fb40a0a2640 1 Processor -- start 2024-04-13T02:45:47.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.831+0000 7fb40a0a2640 1 -- start start 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40406fc80 0x7fb404159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 0x7fb404143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb40415a440 0x7fb404141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb40406f510 con 0x7fb4040cd620 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb40415ddc0 con 0x7fb40415a440 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb404072690 con 0x7fb40406fc80 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 0x7fb404143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 0x7fb404143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38276/0 (socket says 172.21.15.114:38276) 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 -- 172.21.15.114:0/3821003775 learned_addr learned my addr 172.21.15.114:0/3821003775 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb403fff640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb40415a440 0x7fb404141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb4037fe640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40406fc80 0x7fb404159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 -- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40406fc80 msgr2=0x7fb404159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40406fc80 0x7fb404159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 -- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb40415a440 msgr2=0x7fb404141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb40415a440 0x7fb404141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 -- 172.21.15.114:0/3821003775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404141ac0 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb403fff640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb40415a440 0x7fb404141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb402ffd640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 0x7fb404143840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f802b950 tx=0x7fb3f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8040070 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f803a420 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8035040 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb404141da0 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.832+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4040ad400 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.833+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb404068c80 con 0x7fb4040cd620 2024-04-13T02:45:47.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.834+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3f804b060 con 0x7fb4040cd620 2024-04-13T02:45:47.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.834+0000 7fb3ebfff640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb3f006c920 0x7fb3f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:47.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.834+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7fb3f80adba0 con 0x7fb4040cd620 2024-04-13T02:45:47.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.834+0000 7fb4037fe640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb3f006c920 0x7fb3f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:47.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.835+0000 7fb4037fe640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb3f006c920 0x7fb3f006ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4041408f0 tx=0x7fb3f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:47.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:47.838+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb3f807bed0 con 0x7fb4040cd620 2024-04-13T02:45:48.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.013+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) -- 0x7fb4040cd340 con 0x7fb4040cd620 2024-04-13T02:45:48.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.013+0000 7fb3ebfff640 1 -- 172.21.15.114:0/3821003775 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v34) ==== 97+0+11 (secure 0 0 0) 0x7fb3f807b7d0 con 0x7fb4040cd620 2024-04-13T02:45:48.014 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:45:48.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb3f006c920 msgr2=0x7fb3f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb3f006c920 0x7fb3f006ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb4041408f0 tx=0x7fb3f4008040 comp rx=0 tx=0).stop 2024-04-13T02:45:48.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 msgr2=0x7fb404143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 0x7fb404143840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f802b950 tx=0x7fb3f80046c0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 shutdown_connections 2024-04-13T02:45:48.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb40415a440 0x7fb404141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cd620 0x7fb404143840 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb3f006c920 0x7fb3f006ede0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 --2- 172.21.15.114:0/3821003775 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb40406fc80 0x7fb404159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 >> 172.21.15.114:0/3821003775 conn(0x7fb4040b2460 msgr2=0x7fb4040b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:48.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 shutdown_connections 2024-04-13T02:45:48.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.015+0000 7fb40a0a2640 1 -- 172.21.15.114:0/3821003775 wait complete. 2024-04-13T02:45:48.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-13T02:45:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.127+0000 7f7e5dd5e640 1 Processor -- start 2024-04-13T02:45:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e5dd5e640 1 -- start start 2024-04-13T02:45:48.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e5dd5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e580d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e5dd5e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7e580d2c30 0x7f7e580ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e5dd5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580ba8d0 con 0x7f7e580d1300 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e5dd5e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7e580d3090 con 0x7f7e580d2c30 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e5dd5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7e580d32c0 con 0x7f7e5815ec40 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e57fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7e580d1300 0x7f7e580b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52476/0 (socket says 172.21.15.114:52476) 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.128+0000 7f7e57fff640 1 -- 172.21.15.114:0/745341807 learned_addr learned my addr 172.21.15.114:0/745341807 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/745341807 >> v2:172.21.15.130:3300/0 conn(0x7f7e580d2c30 0x7f7e580ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e577fe640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e580d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395772550 0 0) 0x7f7e580ba8d0 con 0x7f7e580d1300 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e40003520 con 0x7f7e580d1300 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2980340507 0 0) 0x7f7e40003520 con 0x7f7e580d1300 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 msgr2=0x7f7e580d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e580d4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 >> v2:172.21.15.130:3300/0 conn(0x7f7e580d2c30 msgr2=0x7f7e580ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 --2- 172.21.15.114:0/745341807 >> v2:172.21.15.130:3300/0 conn(0x7f7e580d2c30 0x7f7e580ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580d35a0 con 0x7f7e580d1300 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f7e500019f0 con 0x7f7e580d1300 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 >> v1:172.21.15.114:6789/0 conn(0x7f7e580d1300 legacy=0x7f7e580b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e400039b0 0x7f7e40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e40004800 0x7f7e40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580d32c0 con 0x7f7e40004800 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4000b9c0 con 0x7f7e400039b0 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4000bb40 con 0x7f7e5815ec40 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e40004800 0x7f7e40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e57fff640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e577fe640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e400039b0 0x7f7e40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 -- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 msgr2=0x7f7e400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 -- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e400039b0 msgr2=0x7f7e40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e400039b0 0x7f7e40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e56ffd640 1 -- 172.21.15.114:0/745341807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40003520 con 0x7f7e40004800 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e57fff640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e5815ec40 0x7f7e400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.129+0000 7f7e577fe640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e400039b0 0x7f7e40003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.130+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e40004800 0x7f7e40004c80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009ac0 tx=0x7f7e40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596bffd19d21cb07 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.130+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c039070 con 0x7f7e40004800 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.130+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c02c710 con 0x7f7e40004800 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.130+0000 7f7e567fc640 1 -- 172.21.15.114:0/745341807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c009690 con 0x7f7e40004800 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/745341807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e40004800 msgr2=0x7f7e40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/745341807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e40004800 0x7f7e40004c80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009ac0 tx=0x7f7e40005830 comp rx=0 tx=0).stop 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e57fff640 1 -- 172.21.15.114:0/745341807 reap_dead start 2024-04-13T02:45:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/745341807 shutdown_connections 2024-04-13T02:45:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/745341807 >> 172.21.15.114:0/745341807 conn(0x7f7e58073690 msgr2=0x7f7e5806cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/745341807 shutdown_connections 2024-04-13T02:45:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.131+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/745341807 wait complete. 2024-04-13T02:45:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.132+0000 7f7e5dd5e640 1 Processor -- start 2024-04-13T02:45:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.132+0000 7f7e5dd5e640 1 -- start start 2024-04-13T02:45:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e5dd5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e40004800 0x7f7e5814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e5dd5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 0x7f7e580ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e5dd5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e580b5d30 0x7f7e580b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e5dd5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580d3e40 con 0x7f7e580ca480 2024-04-13T02:45:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e5dd5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580d3b60 con 0x7f7e40004800 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e5dd5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7e580d4360 con 0x7f7e580b5d30 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 0x7f7e580ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 0x7f7e580ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38284/0 (socket says 172.21.15.114:38284) 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 -- 172.21.15.114:0/3533015976 learned_addr learned my addr 172.21.15.114:0/3533015976 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e57fff640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e580b5d30 0x7f7e580b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e577fe640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e40004800 0x7f7e5814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 -- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e580b5d30 msgr2=0x7f7e580b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e580b5d30 0x7f7e580b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 -- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e40004800 msgr2=0x7f7e5814d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e40004800 0x7f7e5814d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 -- 172.21.15.114:0/3533015976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580b6a60 con 0x7f7e580ca480 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e57fff640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e580b5d30 0x7f7e580b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e577fe640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e40004800 0x7f7e5814d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:45:48.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.133+0000 7f7e56ffd640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 0x7f7e580ca900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c037040 tx=0x7f7e4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.134+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c039050 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.134+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c045070 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.134+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e580b6d40 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.134+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c003a50 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.134+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e580b7300 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.134+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e580d0c90 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.135+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e4c003bf0 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.135+0000 7f7e3ffff640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7e4406c920 0x7f7e4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.135+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f7e4c0ad900 con 0x7f7e580ca480 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.135+0000 7f7e577fe640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7e4406c920 0x7f7e4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:45:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.136+0000 7f7e577fe640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7e4406c920 0x7f7e4406ede0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006d40 tx=0x7f7e48008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:45:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.140+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e580d0c90 con 0x7f7e580ca480 2024-04-13T02:45:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.329+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e58068c80 con 0x7f7e580ca480 2024-04-13T02:45:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.329+0000 7f7e3ffff640 1 -- 172.21.15.114:0/3533015976 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f7e4c04e020 con 0x7f7e580ca480 2024-04-13T02:45:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-04-13T02:45:48.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7e4406c920 msgr2=0x7f7e4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7e4406c920 0x7f7e4406ede0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006d40 tx=0x7f7e48008040 comp rx=0 tx=0).stop 2024-04-13T02:45:48.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 msgr2=0x7f7e580ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:45:48.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 0x7f7e580ca900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c037040 tx=0x7f7e4c004730 comp rx=0 tx=0).stop 2024-04-13T02:45:48.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 shutdown_connections 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f7e4406c920 0x7f7e4406ede0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7e580b5d30 0x7f7e580b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e580ca480 0x7f7e580ca900 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 --2- 172.21.15.114:0/3533015976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7e40004800 0x7f7e5814d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 >> 172.21.15.114:0/3533015976 conn(0x7f7e58073690 msgr2=0x7f7e5815f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 shutdown_connections 2024-04-13T02:45:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:45:48.331+0000 7f7e5dd5e640 1 -- 172.21.15.114:0/3533015976 wait complete. 2024-04-13T02:45:48.343 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-13T02:45:48.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:45:48.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-13T02:45:52.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-13T02:45:58.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2024-04-13T02:46:03.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:46:03.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:03.112 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-13T02:46:03.129 INFO:tasks.cephfs.mount:Terminating background process 2024-04-13T02:46:03.130 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:46:03.130 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:03.148 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17585 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-13T02:46:03.148 INFO:tasks.cephfs.mount:Terminating background process 2024-04-13T02:46:03.148 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:46:03.149 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:03.187 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=463 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-13T02:46:03.187 INFO:tasks.cephfs.mount:Terminating background process 2024-04-13T02:46:03.187 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:46:03.187 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:03.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17585 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-13T02:46:03.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:46:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.336+0000 7f6801ff0640 1 Processor -- start 2024-04-13T02:46:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.337+0000 7f6801ff0640 1 -- start start 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.337+0000 7f6801ff0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 0x7f67fc15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.337+0000 7f6801ff0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f67fc0b6bc0 0x7f67fc0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.337+0000 7f6801ff0640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67fc15fa20 con 0x7f67fc0b2f20 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.337+0000 7f6801ff0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f67fc163670 con 0x7f67fc0b6bc0 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.337+0000 7f6801ff0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc15fd00 con 0x7f67fc148450 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 0x7f67fc15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fbfff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f67fc0b6bc0 0x7f67fc0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67faffd640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f67fc0b2f20 0x7f67fc162f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:48256/0 (socket says 172.21.15.114:48256) 2024-04-13T02:46:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 0x7f67fc15f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:57120/0 (socket says 172.21.15.114:57120) 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67faffd640 1 -- 172.21.15.114:0/538060433 learned_addr learned my addr 172.21.15.114:0/538060433 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fa7fc640 1 -- 172.21.15.114:0/538060433 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672003105 0 0) 0x7f67fc15fa20 con 0x7f67fc0b2f20 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fa7fc640 1 -- 172.21.15.114:0/538060433 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e4003520 con 0x7f67fc0b2f20 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fb7fe640 1 -- 172.21.15.114:0/538060433 >> v2:172.21.15.130:3300/0 conn(0x7f67fc0b6bc0 msgr2=0x7f67fc0b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fb7fe640 1 --2- 172.21.15.114:0/538060433 >> v2:172.21.15.130:3300/0 conn(0x7f67fc0b6bc0 0x7f67fc0b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fb7fe640 1 -- 172.21.15.114:0/538060433 >> v1:172.21.15.130:6789/0 conn(0x7f67fc0b2f20 legacy=0x7f67fc162f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fb7fe640 1 -- 172.21.15.114:0/538060433 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc162760 con 0x7f67fc148450 2024-04-13T02:46:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.338+0000 7f67fbfff640 1 --2- 172.21.15.114:0/538060433 >> v2:172.21.15.130:3300/0 conn(0x7f67fc0b6bc0 0x7f67fc0b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.339+0000 7f67fb7fe640 1 --2- 172.21.15.114:0/538060433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 0x7f67fc15f0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009d90 tx=0x7f67ec02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c787edb23bfbf47 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.339+0000 7f67fa7fc640 1 -- 172.21.15.114:0/538060433 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec039070 con 0x7f67fc148450 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.339+0000 7f67fa7fc640 1 -- 172.21.15.114:0/538060433 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ec02cc50 con 0x7f67fc148450 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.339+0000 7f67fa7fc640 1 -- 172.21.15.114:0/538060433 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec034440 con 0x7f67fc148450 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 -- 172.21.15.114:0/538060433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 msgr2=0x7f67fc15f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 --2- 172.21.15.114:0/538060433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 0x7f67fc15f0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009d90 tx=0x7f67ec02bea0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 -- 172.21.15.114:0/538060433 shutdown_connections 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 --2- 172.21.15.114:0/538060433 >> v2:172.21.15.130:3300/0 conn(0x7f67fc0b6bc0 0x7f67fc0b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 --2- 172.21.15.114:0/538060433 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc148450 0x7f67fc15f0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 -- 172.21.15.114:0/538060433 >> 172.21.15.114:0/538060433 conn(0x7f67fc09aa40 msgr2=0x7f67fc09ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 -- 172.21.15.114:0/538060433 shutdown_connections 2024-04-13T02:46:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.340+0000 7f6801ff0640 1 -- 172.21.15.114:0/538060433 wait complete. 2024-04-13T02:46:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.341+0000 7f6801ff0640 1 Processor -- start 2024-04-13T02:46:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.341+0000 7f6801ff0640 1 -- start start 2024-04-13T02:46:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f6801ff0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67fc0b2f20 0x7f67fc15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f6801ff0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc0b6bc0 0x7f67fc13ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f6801ff0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 0x7f67fc13eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f6801ff0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc15f610 con 0x7f67fc148450 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f6801ff0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc15ffe0 con 0x7f67fc0b2f20 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f6801ff0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc15f790 con 0x7f67fc0b6bc0 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 0x7f67fc13eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 0x7f67fc13eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56922/0 (socket says 172.21.15.114:56922) 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 -- 172.21.15.114:0/652259847 learned_addr learned my addr 172.21.15.114:0/652259847 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fb7fe640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67fc0b2f20 0x7f67fc15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67faffd640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc0b6bc0 0x7f67fc13ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 -- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc0b6bc0 msgr2=0x7f67fc13ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc0b6bc0 0x7f67fc13ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 -- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67fc0b2f20 msgr2=0x7f67fc15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67fc0b2f20 0x7f67fc15dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.342+0000 7f67fbfff640 1 -- 172.21.15.114:0/652259847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc141750 con 0x7f67fc148450 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.343+0000 7f67fbfff640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 0x7f67fc13eac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e8b0 tx=0x7f67f400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.343+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4017070 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.343+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f4004020 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.343+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc145540 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.343+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f40043f0 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.343+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc145b00 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.344+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67fc068c80 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.344+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f67f400c940 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.345+0000 7f67e3fff640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67e806c8f0 0x7f67e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.345+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7f67f408b9b0 con 0x7f67fc148450 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.345+0000 7f67fb7fe640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67e806c8f0 0x7f67e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.345+0000 7f67fb7fe640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67e806c8f0 0x7f67e806edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f67ec036000 tx=0x7f67ec030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.349+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67fc141750 con 0x7f67fc148450 2024-04-13T02:46:03.424 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-04-13T02:46:03.424+0000 7fad7e7f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:46:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.564+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67fc160dc0 con 0x7f67fc148450 2024-04-13T02:46:03.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.564+0000 7f67e3fff640 1 -- 172.21.15.114:0/652259847 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4366 (secure 0 0 0) 0x7f67f4059640 con 0x7f67fc148450 2024-04-13T02:46:03.565 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:03.565 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:46:03.101888+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5079,"qdb_cluster":[5079]},"id":2}]} 2024-04-13T02:46:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-04-13T02:46:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67e806c8f0 msgr2=0x7f67e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67e806c8f0 0x7f67e806edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f67ec036000 tx=0x7f67ec030000 comp rx=0 tx=0).stop 2024-04-13T02:46:03.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 msgr2=0x7f67fc13eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 0x7f67fc13eac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e8b0 tx=0x7f67f400ed70 comp rx=0 tx=0).stop 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 shutdown_connections 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67fc148450 0x7f67fc13eac0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f67e806c8f0 0x7f67e806edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67fc0b6bc0 0x7f67fc13ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 --2- 172.21.15.114:0/652259847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67fc0b2f20 0x7f67fc15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 >> 172.21.15.114:0/652259847 conn(0x7f67fc09aa40 msgr2=0x7f67fc0d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 shutdown_connections 2024-04-13T02:46:03.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.566+0000 7f6801ff0640 1 -- 172.21.15.114:0/652259847 wait complete. 2024-04-13T02:46:03.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:46:03.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.678+0000 7ff4b891e640 1 Processor -- start 2024-04-13T02:46:03.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.679+0000 7ff4b891e640 1 -- start start 2024-04-13T02:46:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.679+0000 7ff4b891e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 0x7ff4b40d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.679+0000 7ff4b891e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40d2d90 con 0x7ff4b40d1300 2024-04-13T02:46:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.679+0000 7ff4b891e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40d3070 con 0x7ff4b415eac0 2024-04-13T02:46:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.679+0000 7ff4b891e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b40d1cd0 con 0x7ff4b40b8c90 2024-04-13T02:46:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b1d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff4b40d1300 0x7ff4b40b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52076/0 (socket says 172.21.15.114:52076) 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b1d9b640 1 -- 172.21.15.114:0/613062005 learned_addr learned my addr 172.21.15.114:0/613062005 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b2d9d640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 0x7ff4b40d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837239402 0 0) 0x7ff4b40d2d90 con 0x7ff4b40d1300 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff49c003520 con 0x7ff4b40d1300 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997836196 0 0) 0x7ff4b40d3070 con 0x7ff4b415eac0 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4b40d2d90 con 0x7ff4b415eac0 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3630508861 0 0) 0x7ff49c003520 con 0x7ff4b40d1300 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 msgr2=0x7ff4b40d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 0x7ff4b40d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 >> v1:172.21.15.130:6789/0 conn(0x7ff4b415eac0 legacy=0x7ff4b40d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b40d3350 con 0x7ff4b40d1300 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7ff4a40015f0 con 0x7ff4b40d1300 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 >> v1:172.21.15.114:6789/0 conn(0x7ff4b40d1300 legacy=0x7ff4b40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff49c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 0x7ff49c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49c004d40 0x7ff49c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b40d1cd0 con 0x7ff49c003b70 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c00ba70 con 0x7ff49c004d40 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff49c00bc70 con 0x7ff4b40b8c90 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b259c640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff49c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b2d9d640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49c004d40 0x7ff49c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.680+0000 7ff4b1d9b640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 0x7ff49c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b259c640 1 -- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 msgr2=0x7ff49c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b259c640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b40b8c90 0x7ff49c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b259c640 1 -- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49c004d40 msgr2=0x7ff49c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b259c640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49c004d40 0x7ff49c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b259c640 1 -- 172.21.15.114:0/613062005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c003520 con 0x7ff49c003b70 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b2d9d640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49c004d40 0x7ff49c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b259c640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff49c003f70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80018d0 tx=0x7ff49c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfce228ded4a8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8037070 con 0x7ff49c003b70 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a80052d0 con 0x7ff49c003b70 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.681+0000 7ff4b159a640 1 -- 172.21.15.114:0/613062005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80014f0 con 0x7ff49c003b70 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b891e640 1 -- 172.21.15.114:0/613062005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 msgr2=0x7ff49c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b891e640 1 --2- 172.21.15.114:0/613062005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff49c003f70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80018d0 tx=0x7ff49c005830 comp rx=0 tx=0).stop 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b2d9d640 1 -- 172.21.15.114:0/613062005 reap_dead start 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b891e640 1 -- 172.21.15.114:0/613062005 shutdown_connections 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b891e640 1 -- 172.21.15.114:0/613062005 >> 172.21.15.114:0/613062005 conn(0x7ff4b4073690 msgr2=0x7ff4b406cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b891e640 1 -- 172.21.15.114:0/613062005 shutdown_connections 2024-04-13T02:46:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.682+0000 7ff4b891e640 1 -- 172.21.15.114:0/613062005 wait complete. 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.683+0000 7ff4b891e640 1 Processor -- start 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.683+0000 7ff4b891e640 1 -- start start 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b891e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff4b41f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b891e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4b4155770 0x7ff4b41f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b891e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b4155e30 0x7ff4b415fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b891e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b415eea0 con 0x7ff49c003b70 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b891e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b40d3910 con 0x7ff4b4155770 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b891e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b40d4590 con 0x7ff4b4155e30 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff4b41f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff4b41f7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56940/0 (socket says 172.21.15.114:56940) 2024-04-13T02:46:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 -- 172.21.15.114:0/1125970385 learned_addr learned my addr 172.21.15.114:0/1125970385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 -- 172.21.15.114:0/1125970385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b4155e30 msgr2=0x7ff4b415fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b4155e30 0x7ff4b415fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 -- 172.21.15.114:0/1125970385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4b4155770 msgr2=0x7ff4b41f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4b4155770 0x7ff4b41f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.684+0000 7ff4b259c640 1 -- 172.21.15.114:0/1125970385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b4155bf0 con 0x7ff49c003b70 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.685+0000 7ff4b259c640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff4b41f7d50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8005040 tx=0x7ff4a80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.685+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8042020 con 0x7ff49c003b70 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.685+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a8038040 con 0x7ff49c003b70 2024-04-13T02:46:03.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.685+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b41f8430 con 0x7ff49c003b70 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.685+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8037070 con 0x7ff49c003b70 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.685+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b41f89f0 con 0x7ff49c003b70 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.686+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b41f8c30 con 0x7ff49c003b70 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.686+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff4a8045020 con 0x7ff49c003b70 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.687+0000 7ff4a2ffd640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff49406c920 0x7ff49406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.687+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7ff4a80ad910 con 0x7ff49c003b70 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.687+0000 7ff4b1d9b640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff49406c920 0x7ff49406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.687+0000 7ff4b1d9b640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff49406c920 0x7ff49406ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4001b10 tx=0x7ff4a4001a60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.691+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff4b41f8c30 con 0x7ff49c003b70 2024-04-13T02:46:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.867+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4b4068c80 con 0x7ff49c003b70 2024-04-13T02:46:03.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.868+0000 7ff4a2ffd640 1 -- 172.21.15.114:0/1125970385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+18648 (secure 0 0 0) 0x7ff4a804c030 con 0x7ff49c003b70 2024-04-13T02:46:03.869 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:03.869 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:46:00.091000+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-04-13T02:45:43.069443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/2419206521":"2024-04-14T02:46:00.090906+0000","172.21.15.114:6835/2419206521":"2024-04-14T02:46:00.090906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:46:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.870+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff49406c920 msgr2=0x7ff49406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.870+0000 7ff4b891e640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff49406c920 0x7ff49406ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4001b10 tx=0x7ff4a4001a60 comp rx=0 tx=0).stop 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.870+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 msgr2=0x7ff4b41f7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.870+0000 7ff4b891e640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff4b41f7d50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8005040 tx=0x7ff4a80012d0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 shutdown_connections 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff49406c920 0x7ff49406ede0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4b4155e30 0x7ff4b415fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4b4155770 0x7ff4b41f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 --2- 172.21.15.114:0/1125970385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49c003b70 0x7ff4b41f7d50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 >> 172.21.15.114:0/1125970385 conn(0x7ff4b4073690 msgr2=0x7ff4b40b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 shutdown_connections 2024-04-13T02:46:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.871+0000 7ff4b891e640 1 -- 172.21.15.114:0/1125970385 wait complete. 2024-04-13T02:46:03.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-13T02:44:27.502094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-13T02:45:26.236118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-13T02:45:26.746769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'data_new', 'create_time': '2024-04-13T02:45:43.069443+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-13T02:46:03.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-13T02:46:03.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.985+0000 7ff59ef1e640 1 Processor -- start 2024-04-13T02:46:03.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.985+0000 7ff59ef1e640 1 -- start start 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59ef1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815b9e0 0x7ff59806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59ef1e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5980ce320 0x7ff5980ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59ef1e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff598068210 con 0x7ff59815f3d0 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59ef1e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff5980cecc0 con 0x7ff5980ce320 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59ef1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff5980b4280 con 0x7ff59815b9e0 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff597fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5980ce320 0x7ff5980ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59d4bb640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff59815f3d0 0x7ff59815f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52090/0 (socket says 172.21.15.114:52090) 2024-04-13T02:46:03.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff59d4bb640 1 -- 172.21.15.114:0/3260736641 learned_addr learned my addr 172.21.15.114:0/3260736641 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:03.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff597fff640 1 -- 172.21.15.114:0/3260736641 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815b9e0 msgr2=0x7ff59806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:03.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff597fff640 1 --2- 172.21.15.114:0/3260736641 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815b9e0 0x7ff59806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff597fff640 1 -- 172.21.15.114:0/3260736641 >> v1:172.21.15.114:6789/0 conn(0x7ff59815f3d0 legacy=0x7ff59815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff597fff640 1 -- 172.21.15.114:0/3260736641 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff598067c50 con 0x7ff5980ce320 2024-04-13T02:46:03.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.986+0000 7ff5977fe640 1 -- 172.21.15.114:0/3260736641 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038147011 0 0) 0x7ff598068210 con 0x7ff59815f3d0 2024-04-13T02:46:03.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.987+0000 7ff597fff640 1 --2- 172.21.15.114:0/3260736641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff5980ce780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097a0 tx=0x7ff58402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74058a20df4a8fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.987+0000 7ff5977fe640 1 -- 172.21.15.114:0/3260736641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584038070 con 0x7ff5980ce320 2024-04-13T02:46:03.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.987+0000 7ff5977fe640 1 -- 172.21.15.114:0/3260736641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff584031700 con 0x7ff5980ce320 2024-04-13T02:46:03.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.987+0000 7ff5977fe640 1 -- 172.21.15.114:0/3260736641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584031ad0 con 0x7ff5980ce320 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.987+0000 7ff59ef1e640 1 -- 172.21.15.114:0/3260736641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 msgr2=0x7ff5980ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.987+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/3260736641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff5980ce780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097a0 tx=0x7ff58402b7a0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.988+0000 7ff59ef1e640 1 -- 172.21.15.114:0/3260736641 shutdown_connections 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.988+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/3260736641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff5980ce780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.988+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/3260736641 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815b9e0 0x7ff59806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.988+0000 7ff59ef1e640 1 -- 172.21.15.114:0/3260736641 >> 172.21.15.114:0/3260736641 conn(0x7ff59806ea10 msgr2=0x7ff59806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.988+0000 7ff59ef1e640 1 -- 172.21.15.114:0/3260736641 shutdown_connections 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.988+0000 7ff59ef1e640 1 -- 172.21.15.114:0/3260736641 wait complete. 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.989+0000 7ff59ef1e640 1 Processor -- start 2024-04-13T02:46:03.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.989+0000 7ff59ef1e640 1 -- start start 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.989+0000 7ff59ef1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff59813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.989+0000 7ff59ef1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff59815b9e0 0x7ff598157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.989+0000 7ff59ef1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815f3d0 0x7ff5980d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.989+0000 7ff59ef1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff59815bdc0 con 0x7ff5980ce320 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ef1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5980b4520 con 0x7ff59815b9e0 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ef1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff59806d190 con 0x7ff59815f3d0 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff59813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff59813e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56972/0 (socket says 172.21.15.114:56972) 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 -- 172.21.15.114:0/415611331 learned_addr learned my addr 172.21.15.114:0/415611331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff597fff640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff59815b9e0 0x7ff598157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59d4bb640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815f3d0 0x7ff5980d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 -- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815f3d0 msgr2=0x7ff5980d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815f3d0 0x7ff5980d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 -- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff59815b9e0 msgr2=0x7ff598157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff59815b9e0 0x7ff598157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 -- 172.21.15.114:0/415611331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59806b9d0 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ccba640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff59813e250 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00b410 tx=0x7ff58c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c015020 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c011850 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c011c40 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59806bcb0 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.990+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59806c270 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.991+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff598068c80 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.992+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff58c018020 con 0x7ff5980ce320 2024-04-13T02:46:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.992+0000 7ff5957fa640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff57c06c8f0 0x7ff57c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.992+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7ff58c08bc10 con 0x7ff5980ce320 2024-04-13T02:46:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.992+0000 7ff597fff640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff57c06c8f0 0x7ff57c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.992+0000 7ff597fff640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff57c06c8f0 0x7ff57c06edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff584035000 tx=0x7ff584008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:03.996+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff58c01f020 con 0x7ff5980ce320 2024-04-13T02:46:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.172+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff59806daa0 con 0x7ff5980ce320 2024-04-13T02:46:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.173+0000 7ff5957fa640 1 -- 172.21.15.114:0/415611331 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7ff58c0172c0 con 0x7ff5980ce320 2024-04-13T02:46:04.174 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff57c06c8f0 msgr2=0x7ff57c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff57c06c8f0 0x7ff57c06edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff584035000 tx=0x7ff584008030 comp rx=0 tx=0).stop 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 msgr2=0x7ff59813e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff59813e250 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00b410 tx=0x7ff58c00b8d0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 shutdown_connections 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff57c06c8f0 0x7ff57c06edb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff59815f3d0 0x7ff5980d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff59815b9e0 0x7ff598157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 --2- 172.21.15.114:0/415611331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5980ce320 0x7ff59813e250 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 >> 172.21.15.114:0/415611331 conn(0x7ff59806ea10 msgr2=0x7ff598150850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 shutdown_connections 2024-04-13T02:46:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.175+0000 7ff59ef1e640 1 -- 172.21.15.114:0/415611331 wait complete. 2024-04-13T02:46:04.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-13T02:46:04.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:04.233 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:04.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.290+0000 7fa92b1a5640 1 Processor -- start 2024-04-13T02:46:04.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.290+0000 7fa92b1a5640 1 -- start start 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa92b1a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9240b0650 0x7fa924162580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa92b1a5640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa92406cf80 0x7fa92415f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa92b1a5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa924073920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa92b1a5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fa924073e60 con 0x7fa9240b0650 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa92b1a5640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa92415f0a0 con 0x7fa92406cf80 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa92b1a5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240b0a30 con 0x7fa9240734f0 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa928f41640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9240b0650 0x7fa924162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa928f41640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9240b0650 0x7fa924162580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56984/0 (socket says 172.21.15.114:56984) 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.291+0000 7fa928f41640 1 -- 172.21.15.114:0/3651047871 learned_addr learned my addr 172.21.15.114:0/3651047871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa928f41640 1 -- 172.21.15.114:0/3651047871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 msgr2=0x7fa924073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa928f41640 1 --2- 172.21.15.114:0/3651047871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa924073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa928f41640 1 -- 172.21.15.114:0/3651047871 >> v2:172.21.15.130:3300/0 conn(0x7fa92406cf80 msgr2=0x7fa92415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa928f41640 1 --2- 172.21.15.114:0/3651047871 >> v2:172.21.15.130:3300/0 conn(0x7fa92406cf80 0x7fa92415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa928f41640 1 -- 172.21.15.114:0/3651047871 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924162e40 con 0x7fa9240b0650 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa928f41640 1 --2- 172.21.15.114:0/3651047871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9240b0650 0x7fa924162580 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9240cd260 tx=0x7fa91402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766e4a63abf46ea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa9237fe640 1 -- 172.21.15.114:0/3651047871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914035020 con 0x7fa9240b0650 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa9237fe640 1 -- 172.21.15.114:0/3651047871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa914031640 con 0x7fa9240b0650 2024-04-13T02:46:04.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.292+0000 7fa9237fe640 1 -- 172.21.15.114:0/3651047871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91402d040 con 0x7fa9240b0650 2024-04-13T02:46:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3651047871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9240b0650 msgr2=0x7fa924162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3651047871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9240b0650 0x7fa924162580 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9240cd260 tx=0x7fa91402b8f0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3651047871 shutdown_connections 2024-04-13T02:46:04.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3651047871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa924073920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3651047871 >> v2:172.21.15.130:3300/0 conn(0x7fa92406cf80 0x7fa92415f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3651047871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9240b0650 0x7fa924162580 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3651047871 >> 172.21.15.114:0/3651047871 conn(0x7fa924072a00 msgr2=0x7fa924072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3651047871 shutdown_connections 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.293+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3651047871 wait complete. 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.294+0000 7fa92b1a5640 1 Processor -- start 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.294+0000 7fa92b1a5640 1 -- start start 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa92b1a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 0x7fa924158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa92b1a5640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa9240cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa92b1a5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9240b0650 0x7fa9240b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa92b1a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa924163400 con 0x7fa92406cf80 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa92b1a5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa92415f310 con 0x7fa9240b0650 2024-04-13T02:46:04.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa92b1a5640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa924162ac0 con 0x7fa9240734f0 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 0x7fa924158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 0x7fa924158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56990/0 (socket says 172.21.15.114:56990) 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 -- 172.21.15.114:0/3971086486 learned_addr learned my addr 172.21.15.114:0/3971086486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa923fff640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa9240cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa929742640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9240b0650 0x7fa9240b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 -- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 msgr2=0x7fa9240cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa9240cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 -- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9240b0650 msgr2=0x7fa9240b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9240b0650 0x7fa9240b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa928f41640 1 -- 172.21.15.114:0/3971086486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924144520 con 0x7fa92406cf80 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa923fff640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa9240cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.295+0000 7fa929742640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9240b0650 0x7fa9240b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.296+0000 7fa928f41640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 0x7fa924158ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa91402b930 tx=0x7fa9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.296+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91403ac60 con 0x7fa92406cf80 2024-04-13T02:46:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.296+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91403ae20 con 0x7fa92406cf80 2024-04-13T02:46:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.296+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa924144800 con 0x7fa92406cf80 2024-04-13T02:46:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.296+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914044630 con 0x7fa92406cf80 2024-04-13T02:46:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.296+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa924144dc0 con 0x7fa92406cf80 2024-04-13T02:46:04.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.297+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa924068c80 con 0x7fa92406cf80 2024-04-13T02:46:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.297+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa91404b060 con 0x7fa92406cf80 2024-04-13T02:46:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.298+0000 7fa9217fa640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa91006c8f0 0x7fa91006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.298+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7fa9140ad990 con 0x7fa92406cf80 2024-04-13T02:46:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.298+0000 7fa923fff640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa91006c8f0 0x7fa91006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.298+0000 7fa923fff640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa91006c8f0 0x7fa91006edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa918006fd0 tx=0x7fa918008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.302+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa91403f070 con 0x7fa92406cf80 2024-04-13T02:46:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.475+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa924070120 con 0x7fa92406cf80 2024-04-13T02:46:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.476+0000 7fa9217fa640 1 -- 172.21.15.114:0/3971086486 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) ==== 104+0+11 (secure 0 0 0) 0x7fa91402f300 con 0x7fa92406cf80 2024-04-13T02:46:04.477 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa91006c8f0 msgr2=0x7fa91006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa91006c8f0 0x7fa91006edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa918006fd0 tx=0x7fa918008040 comp rx=0 tx=0).stop 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 msgr2=0x7fa924158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 0x7fa924158ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa91402b930 tx=0x7fa9140046c0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 shutdown_connections 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9240b0650 0x7fa9240b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa91006c8f0 0x7fa91006edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9240734f0 0x7fa9240cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 --2- 172.21.15.114:0/3971086486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa92406cf80 0x7fa924158ad0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 >> 172.21.15.114:0/3971086486 conn(0x7fa924072a00 msgr2=0x7fa9240aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 shutdown_connections 2024-04-13T02:46:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.478+0000 7fa92b1a5640 1 -- 172.21.15.114:0/3971086486 wait complete. 2024-04-13T02:46:04.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-13T02:46:04.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.632+0000 7f5a377f0640 1 Processor -- start 2024-04-13T02:46:04.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.633+0000 7f5a377f0640 1 -- start start 2024-04-13T02:46:04.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.633+0000 7f5a377f0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a3015ebc0 0x7f5a3006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.633+0000 7f5a377f0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5a3015f810 0x7f5a30070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.633+0000 7f5a377f0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3015fe30 con 0x7f5a30163300 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.633+0000 7f5a377f0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5a30162e70 con 0x7f5a3015ebc0 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.633+0000 7f5a377f0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5a30162820 con 0x7f5a3015f810 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a3558c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a3015ebc0 0x7f5a3006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a34d8b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5a30163300 0x7f5a3015f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52100/0 (socket says 172.21.15.114:52100) 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a34d8b640 1 -- 172.21.15.114:0/616038121 learned_addr learned my addr 172.21.15.114:0/616038121 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a35d8d640 1 --2- 172.21.15.114:0/616038121 >> v2:172.21.15.130:3300/0 conn(0x7f5a3015f810 0x7f5a30070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a3558c640 1 -- 172.21.15.114:0/616038121 >> v2:172.21.15.130:3300/0 conn(0x7f5a3015f810 msgr2=0x7f5a30070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a3558c640 1 --2- 172.21.15.114:0/616038121 >> v2:172.21.15.130:3300/0 conn(0x7f5a3015f810 0x7f5a30070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a3558c640 1 -- 172.21.15.114:0/616038121 >> v1:172.21.15.114:6789/0 conn(0x7f5a30163300 legacy=0x7f5a3015f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a3558c640 1 -- 172.21.15.114:0/616038121 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a30162b00 con 0x7f5a3015ebc0 2024-04-13T02:46:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.634+0000 7f5a27fff640 1 -- 172.21.15.114:0/616038121 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691666741 0 0) 0x7f5a3015fe30 con 0x7f5a30163300 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a3558c640 1 --2- 172.21.15.114:0/616038121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a3006fbe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5a3006f980 tx=0x7f5a2c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1e1354b8978d1f server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a27fff640 1 -- 172.21.15.114:0/616038121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c039070 con 0x7f5a3015ebc0 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a27fff640 1 -- 172.21.15.114:0/616038121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c02cc80 con 0x7f5a3015ebc0 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a27fff640 1 -- 172.21.15.114:0/616038121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c034660 con 0x7f5a3015ebc0 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 -- 172.21.15.114:0/616038121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 msgr2=0x7f5a3006fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 --2- 172.21.15.114:0/616038121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a3006fbe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5a3006f980 tx=0x7f5a2c02bed0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 -- 172.21.15.114:0/616038121 shutdown_connections 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 --2- 172.21.15.114:0/616038121 >> v2:172.21.15.130:3300/0 conn(0x7f5a3015f810 0x7f5a30070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 --2- 172.21.15.114:0/616038121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a3006fbe0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 -- 172.21.15.114:0/616038121 >> 172.21.15.114:0/616038121 conn(0x7f5a3009aa40 msgr2=0x7f5a3009ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 -- 172.21.15.114:0/616038121 shutdown_connections 2024-04-13T02:46:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.635+0000 7f5a377f0640 1 -- 172.21.15.114:0/616038121 wait complete. 2024-04-13T02:46:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.636+0000 7f5a377f0640 1 Processor -- start 2024-04-13T02:46:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 -- start start 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a300b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a3015f810 0x7f5a300b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a30163300 0x7f5a30151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5a300d19b0 con 0x7f5a3015ebc0 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a300d1830 con 0x7f5a30163300 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a377f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5a300d1b30 con 0x7f5a3015f810 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a3558c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a300b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a3558c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a300b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57000/0 (socket says 172.21.15.114:57000) 2024-04-13T02:46:04.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.637+0000 7f5a3558c640 1 -- 172.21.15.114:0/315728519 learned_addr learned my addr 172.21.15.114:0/315728519 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a3558c640 1 -- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a3015f810 msgr2=0x7f5a300b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a3558c640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a3015f810 0x7f5a300b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a3558c640 1 -- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a30163300 msgr2=0x7f5a30151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a35d8d640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a30163300 0x7f5a30151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a3558c640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a30163300 0x7f5a30151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a3558c640 1 -- 172.21.15.114:0/315728519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a300b1c40 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a3558c640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a300b56e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c037040 tx=0x7f5a2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c039050 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c045070 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c03e850 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a300b1f80 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.638+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a300b27c0 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.639+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a300753a0 con 0x7f5a3015ebc0 2024-04-13T02:46:04.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.639+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a2c03e9f0 con 0x7f5a3015ebc0 2024-04-13T02:46:04.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.640+0000 7f5a25ffb640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a1406c8f0 0x7f5a1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.640+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7f5a2c0aec40 con 0x7f5a3015ebc0 2024-04-13T02:46:04.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.640+0000 7f5a34d8b640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a1406c8f0 0x7f5a1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.640+0000 7f5a34d8b640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a1406c8f0 0x7f5a1406edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007fd0 tx=0x7f5a20007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.644+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a300753a0 con 0x7f5a3015ebc0 2024-04-13T02:46:04.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.819+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a300ce430 con 0x7f5a3015ebc0 2024-04-13T02:46:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.819+0000 7f5a25ffb640 1 -- 172.21.15.114:0/315728519 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) ==== 100+0+11 (secure 0 0 0) 0x7f5a300b1f80 con 0x7f5a3015ebc0 2024-04-13T02:46:04.820 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.821+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a1406c8f0 msgr2=0x7f5a1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.821+0000 7f5a377f0640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a1406c8f0 0x7f5a1406edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007fd0 tx=0x7f5a20007960 comp rx=0 tx=0).stop 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.821+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 msgr2=0x7f5a300b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.821+0000 7f5a377f0640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a300b56e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c037040 tx=0x7f5a2c004a40 comp rx=0 tx=0).stop 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 shutdown_connections 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a30163300 0x7f5a30151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5a1406c8f0 0x7f5a1406edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a3015f810 0x7f5a300b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 --2- 172.21.15.114:0/315728519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a3015ebc0 0x7f5a300b56e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 >> 172.21.15.114:0/315728519 conn(0x7f5a3009aa40 msgr2=0x7f5a300cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 shutdown_connections 2024-04-13T02:46:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.822+0000 7f5a377f0640 1 -- 172.21.15.114:0/315728519 wait complete. 2024-04-13T02:46:04.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2024-04-13T02:46:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.935+0000 7f0085c20640 1 Processor -- start 2024-04-13T02:46:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.935+0000 7f0085c20640 1 -- start start 2024-04-13T02:46:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f0085c20640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00801622c0 0x7f008006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f0085c20640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00800d2370 0x7f008006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f0085c20640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008006deb0 con 0x7f008006e720 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f0085c20640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f008006dc60 con 0x7f00800d2370 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f0085c20640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f008006e120 con 0x7f00801622c0 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f0076ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00800d2370 0x7f008006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f007ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f008006e720 0x7f00800d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52112/0 (socket says 172.21.15.114:52112) 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.936+0000 7f007ffff640 1 -- 172.21.15.114:0/2991180904 learned_addr learned my addr 172.21.15.114:0/2991180904 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f007f7fe640 1 --2- 172.21.15.114:0/2991180904 >> v2:172.21.15.130:3300/0 conn(0x7f00801622c0 0x7f008006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f0076ffd640 1 -- 172.21.15.114:0/2991180904 >> v2:172.21.15.130:3300/0 conn(0x7f00801622c0 msgr2=0x7f008006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f0076ffd640 1 --2- 172.21.15.114:0/2991180904 >> v2:172.21.15.130:3300/0 conn(0x7f00801622c0 0x7f008006ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f0076ffd640 1 -- 172.21.15.114:0/2991180904 >> v1:172.21.15.114:6789/0 conn(0x7f008006e720 legacy=0x7f00800d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f007effd640 1 -- 172.21.15.114:0/2991180904 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544154135 0 0) 0x7f008006deb0 con 0x7f008006e720 2024-04-13T02:46:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f0076ffd640 1 -- 172.21.15.114:0/2991180904 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008006d6a0 con 0x7f00800d2370 2024-04-13T02:46:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f0076ffd640 1 --2- 172.21.15.114:0/2991180904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f008006cf80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f00800cf1a0 tx=0x7f006802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9e4631cfae5b02 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.937+0000 7f007effd640 1 -- 172.21.15.114:0/2991180904 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068035020 con 0x7f00800d2370 2024-04-13T02:46:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f007effd640 1 -- 172.21.15.114:0/2991180904 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0068031830 con 0x7f00800d2370 2024-04-13T02:46:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f007effd640 1 -- 172.21.15.114:0/2991180904 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068031c00 con 0x7f00800d2370 2024-04-13T02:46:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 -- 172.21.15.114:0/2991180904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 msgr2=0x7f008006cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 --2- 172.21.15.114:0/2991180904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f008006cf80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f00800cf1a0 tx=0x7f006802b8d0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 -- 172.21.15.114:0/2991180904 shutdown_connections 2024-04-13T02:46:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 --2- 172.21.15.114:0/2991180904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f008006cf80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 --2- 172.21.15.114:0/2991180904 >> v2:172.21.15.130:3300/0 conn(0x7f00801622c0 0x7f008006ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 -- 172.21.15.114:0/2991180904 >> 172.21.15.114:0/2991180904 conn(0x7f00800d2750 msgr2=0x7f00800d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 -- 172.21.15.114:0/2991180904 shutdown_connections 2024-04-13T02:46:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.938+0000 7f0085c20640 1 -- 172.21.15.114:0/2991180904 wait complete. 2024-04-13T02:46:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.939+0000 7f0085c20640 1 Processor -- start 2024-04-13T02:46:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.939+0000 7f0085c20640 1 -- start start 2024-04-13T02:46:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0085c20640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f008006e720 0x7f00800b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0085c20640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f0080158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0085c20640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00801622c0 0x7f00801548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0085c20640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f008009bd20 con 0x7f00800d2370 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0085c20640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f008009bba0 con 0x7f00801622c0 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0085c20640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f00800707f0 con 0x7f008006e720 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f0080158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f0080158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57014/0 (socket says 172.21.15.114:57014) 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 -- 172.21.15.114:0/3100396855 learned_addr learned my addr 172.21.15.114:0/3100396855 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f007f7fe640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f008006e720 0x7f00800b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f007ffff640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00801622c0 0x7f00801548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 -- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f008006e720 msgr2=0x7f00800b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f008006e720 0x7f00800b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 -- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00801622c0 msgr2=0x7f00801548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00801622c0 0x7f00801548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.940+0000 7f0076ffd640 1 -- 172.21.15.114:0/3100396855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0080158f70 con 0x7f00800d2370 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.941+0000 7f0076ffd640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f0080158a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0068009890 tx=0x7f00680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.941+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068041070 con 0x7f00800d2370 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.941+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006803aa30 con 0x7f00800d2370 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.941+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0080154e00 con 0x7f00800d2370 2024-04-13T02:46:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.941+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068035040 con 0x7f00800d2370 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.941+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00800b5c30 con 0x7f00800d2370 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.942+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0080068c80 con 0x7f00800d2370 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.942+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0068038020 con 0x7f00800d2370 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.943+0000 7f007cff9640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f006006c8f0 0x7f006006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.943+0000 7f007f7fe640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f006006c8f0 0x7f006006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.943+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7f00680ad9b0 con 0x7f00800d2370 2024-04-13T02:46:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.943+0000 7f007f7fe640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f006006c8f0 0x7f006006edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f007000b7c0 tx=0x7f0070008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:04.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:04.947+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f006807bb80 con 0x7f00800d2370 2024-04-13T02:46:05.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.123+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) -- 0x7f008015fc60 con 0x7f00800d2370 2024-04-13T02:46:05.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.123+0000 7f007cff9640 1 -- 172.21.15.114:0/3100396855 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v35) ==== 97+0+11 (secure 0 0 0) 0x7f006807b480 con 0x7f00800d2370 2024-04-13T02:46:05.124 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-04-13T02:46:05.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f006006c8f0 msgr2=0x7f006006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f006006c8f0 0x7f006006edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f007000b7c0 tx=0x7f0070008040 comp rx=0 tx=0).stop 2024-04-13T02:46:05.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 msgr2=0x7f0080158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f0080158a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0068009890 tx=0x7f00680046c0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 shutdown_connections 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00801622c0 0x7f00801548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800d2370 0x7f0080158a30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f006006c8f0 0x7f006006edb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 --2- 172.21.15.114:0/3100396855 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f008006e720 0x7f00800b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 >> 172.21.15.114:0/3100396855 conn(0x7f00800d2750 msgr2=0x7f0080070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 shutdown_connections 2024-04-13T02:46:05.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.125+0000 7f0085c20640 1 -- 172.21.15.114:0/3100396855 wait complete. 2024-04-13T02:46:05.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:46:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.236+0000 7f271ccc8640 1 Processor -- start 2024-04-13T02:46:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.236+0000 7f271ccc8640 1 -- start start 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271ccc8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f271815eac0 0x7f27180d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271ccc8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27180d43c0 0x7f27180d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271ccc8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27180d1c50 con 0x7f27180d1840 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271ccc8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f27180d2d90 con 0x7f271815eac0 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271ccc8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f27180d3070 con 0x7f27180d43c0 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f271815eac0 0x7f27180d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f2716d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f27180d1840 0x7f27180b3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52114/0 (socket says 172.21.15.114:52114) 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f271659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f271815eac0 0x7f27180d3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57022/0 (socket says 172.21.15.114:57022) 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.237+0000 7f2716d9d640 1 -- 172.21.15.114:0/4079790214 learned_addr learned my addr 172.21.15.114:0/4079790214 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f2715d9b640 1 --2- 172.21.15.114:0/4079790214 >> v2:172.21.15.130:3300/0 conn(0x7f27180d43c0 0x7f27180d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f271659c640 1 -- 172.21.15.114:0/4079790214 >> v2:172.21.15.130:3300/0 conn(0x7f27180d43c0 msgr2=0x7f27180d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f271659c640 1 --2- 172.21.15.114:0/4079790214 >> v2:172.21.15.130:3300/0 conn(0x7f27180d43c0 0x7f27180d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f271659c640 1 -- 172.21.15.114:0/4079790214 >> v1:172.21.15.114:6789/0 conn(0x7f27180d1840 legacy=0x7f27180b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f271559a640 1 -- 172.21.15.114:0/4079790214 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062558397 0 0) 0x7f27180d1c50 con 0x7f27180d1840 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f271659c640 1 -- 172.21.15.114:0/4079790214 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27180d3350 con 0x7f271815eac0 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.238+0000 7f271659c640 1 --2- 172.21.15.114:0/4079790214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271815eac0 0x7f27180d3e80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f27180d20b0 tx=0x7f270802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d307d66e030a66d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271559a640 1 -- 172.21.15.114:0/4079790214 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708039070 con 0x7f271815eac0 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271559a640 1 -- 172.21.15.114:0/4079790214 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270802cc80 con 0x7f271815eac0 2024-04-13T02:46:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271559a640 1 -- 172.21.15.114:0/4079790214 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708034660 con 0x7f271815eac0 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 -- 172.21.15.114:0/4079790214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271815eac0 msgr2=0x7f27180d3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4079790214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271815eac0 0x7f27180d3e80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f27180d20b0 tx=0x7f270802bed0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 -- 172.21.15.114:0/4079790214 shutdown_connections 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4079790214 >> v2:172.21.15.130:3300/0 conn(0x7f27180d43c0 0x7f27180d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4079790214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271815eac0 0x7f27180d3e80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 -- 172.21.15.114:0/4079790214 >> 172.21.15.114:0/4079790214 conn(0x7f2718073690 msgr2=0x7f271806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 -- 172.21.15.114:0/4079790214 shutdown_connections 2024-04-13T02:46:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.239+0000 7f271ccc8640 1 -- 172.21.15.114:0/4079790214 wait complete. 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 Processor -- start 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 -- start start 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27180d1840 0x7f27180cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 0x7f27180abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f271815eac0 0x7f27180ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f271815eea0 con 0x7f27180d43c0 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27180d3910 con 0x7f271815eac0 2024-04-13T02:46:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f271ccc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f27180d29f0 con 0x7f27180d1840 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f2715d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 0x7f27180abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f2715d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 0x7f27180abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57030/0 (socket says 172.21.15.114:57030) 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.241+0000 7f2715d9b640 1 -- 172.21.15.114:0/4017507241 learned_addr learned my addr 172.21.15.114:0/4017507241 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2715d9b640 1 -- 172.21.15.114:0/4017507241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27180d1840 msgr2=0x7f27180cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2715d9b640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27180d1840 0x7f27180cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2715d9b640 1 -- 172.21.15.114:0/4017507241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f271815eac0 msgr2=0x7f27180ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2715d9b640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f271815eac0 0x7f27180ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2715d9b640 1 -- 172.21.15.114:0/4017507241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27180acbe0 con 0x7f27180d43c0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2715d9b640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 0x7f27180abe20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f270c00d800 tx=0x7f270c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c00b6c0 con 0x7f27180d43c0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270c019070 con 0x7f27180d43c0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27180acec0 con 0x7f27180d43c0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c00bac0 con 0x7f27180d43c0 2024-04-13T02:46:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.242+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27180ac8a0 con 0x7f27180d43c0 2024-04-13T02:46:05.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.243+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2718068c80 con 0x7f27180d43c0 2024-04-13T02:46:05.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.243+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f270c00bc60 con 0x7f27180d43c0 2024-04-13T02:46:05.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.244+0000 7f2706ffd640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f26f806c8f0 0x7f26f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.244+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7f270c08c1a0 con 0x7f27180d43c0 2024-04-13T02:46:05.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.244+0000 7f271659c640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f26f806c8f0 0x7f26f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.244+0000 7f271659c640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f26f806c8f0 0x7f26f806edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2708036000 tx=0x7f270802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.248+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f270c05a480 con 0x7f27180d43c0 2024-04-13T02:46:05.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.459+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f271814a550 con 0x7f27180d43c0 2024-04-13T02:46:05.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.460+0000 7f2706ffd640 1 -- 172.21.15.114:0/4017507241 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4366 (secure 0 0 0) 0x7f270c059d80 con 0x7f27180d43c0 2024-04-13T02:46:05.460 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:05.461 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:46:03.101888+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5079,"qdb_cluster":[5079]},"id":2}]} 2024-04-13T02:46:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-04-13T02:46:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f26f806c8f0 msgr2=0x7f26f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f26f806c8f0 0x7f26f806edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2708036000 tx=0x7f270802e000 comp rx=0 tx=0).stop 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 msgr2=0x7f27180abe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 0x7f27180abe20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f270c00d800 tx=0x7f270c00dcc0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 shutdown_connections 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f271815eac0 0x7f27180ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.461+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27180d43c0 0x7f27180abe20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.462+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f26f806c8f0 0x7f26f806edb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.462+0000 7f271ccc8640 1 --2- 172.21.15.114:0/4017507241 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27180d1840 0x7f27180cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.462+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 >> 172.21.15.114:0/4017507241 conn(0x7f2718073690 msgr2=0x7f27180cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.462+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 shutdown_connections 2024-04-13T02:46:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.462+0000 7f271ccc8640 1 -- 172.21.15.114:0/4017507241 wait complete. 2024-04-13T02:46:05.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:46:05.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2024-04-13T02:46:05.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.573+0000 7f0ea6d1e640 1 Processor -- start 2024-04-13T02:46:05.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.573+0000 7f0ea6d1e640 1 -- start start 2024-04-13T02:46:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea6d1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ea006bf80 0x7f0ea015f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea6d1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea0162e70 0x7f0ea00d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea6d1e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea00b6b20 con 0x7f0ea006bba0 2024-04-13T02:46:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea6d1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea00b0610 con 0x7f0ea006bf80 2024-04-13T02:46:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea6d1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea01629e0 con 0x7f0ea0162e70 2024-04-13T02:46:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ea006bf80 0x7f0ea015f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea52bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea0162e70 0x7f0ea00d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ea006bf80 0x7f0ea015f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:54464/0 (socket says 172.21.15.114:54464) 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 -- 172.21.15.114:0/967786227 learned_addr learned my addr 172.21.15.114:0/967786227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea4aba640 1 --1- 172.21.15.114:0/967786227 >> v1:172.21.15.130:6789/0 conn(0x7f0ea006bba0 0x7f0ea00b6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:48278/0 (socket says 172.21.15.114:48278) 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 -- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea0162e70 msgr2=0x7f0ea00d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 --2- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea0162e70 0x7f0ea00d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 -- 172.21.15.114:0/967786227 >> v1:172.21.15.130:6789/0 conn(0x7f0ea006bba0 legacy=0x7f0ea00b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0e97fff640 1 -- 172.21.15.114:0/967786227 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea0162690 con 0x7f0ea006bf80 2024-04-13T02:46:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.574+0000 7f0ea52bb640 1 --2- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea0162e70 0x7f0ea00d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:05.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.575+0000 7f0e97fff640 1 --2- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea006bf80 0x7f0ea015f940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009870 tx=0x7f0e9002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a5dd9f7a5ab4663 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.575+0000 7f0e977fe640 1 -- 172.21.15.114:0/967786227 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90035020 con 0x7f0ea006bf80 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.575+0000 7f0e977fe640 1 -- 172.21.15.114:0/967786227 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90031640 con 0x7f0ea006bf80 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.575+0000 7f0e977fe640 1 -- 172.21.15.114:0/967786227 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9002d040 con 0x7f0ea006bf80 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea006bf80 msgr2=0x7f0ea015f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea006bf80 0x7f0ea015f940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009870 tx=0x7f0e9002b8f0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/967786227 shutdown_connections 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea0162e70 0x7f0ea00d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/967786227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea006bf80 0x7f0ea015f940 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/967786227 >> 172.21.15.114:0/967786227 conn(0x7f0ea0073720 msgr2=0x7f0ea009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/967786227 shutdown_connections 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.576+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/967786227 wait complete. 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.577+0000 7f0ea6d1e640 1 Processor -- start 2024-04-13T02:46:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.577+0000 7f0ea6d1e640 1 -- start start 2024-04-13T02:46:05.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea6d1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea006bba0 0x7f0ea0154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea6d1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 0x7f0ea00b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea6d1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea0162e70 0x7f0ea015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea6d1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00b0e20 con 0x7f0ea006bf80 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea6d1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00b0b40 con 0x7f0ea0162e70 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea6d1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea015fe80 con 0x7f0ea006bba0 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 0x7f0ea00b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 0x7f0ea00b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57042/0 (socket says 172.21.15.114:57042) 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 -- 172.21.15.114:0/670438696 learned_addr learned my addr 172.21.15.114:0/670438696 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea52bb640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea0162e70 0x7f0ea015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea4aba640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea006bba0 0x7f0ea0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 -- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea006bba0 msgr2=0x7f0ea0154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea006bba0 0x7f0ea0154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 -- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea0162e70 msgr2=0x7f0ea015e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea0162e70 0x7f0ea015e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 -- 172.21.15.114:0/670438696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea015a3c0 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0ea4aba640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea006bba0 0x7f0ea0154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.578+0000 7f0e97fff640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 0x7f0ea00b2420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0e9002b930 tx=0x7f0e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.579+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90040070 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.579+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea015a6a0 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.579+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9003e070 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.579+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90035040 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.579+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea015ac60 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.580+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea0068c80 con 0x7f0ea006bf80 2024-04-13T02:46:05.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.580+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e90038020 con 0x7f0ea006bf80 2024-04-13T02:46:05.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.580+0000 7f0e957fa640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e8c06c920 0x7f0e8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.581+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7f0e900ad580 con 0x7f0ea006bf80 2024-04-13T02:46:05.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.581+0000 7f0ea4aba640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e8c06c920 0x7f0e8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.581+0000 7f0ea4aba640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e8c06c920 0x7f0e8c06ede0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c000f60 tx=0x7f0e9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.585+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e9007b7e0 con 0x7f0ea006bf80 2024-04-13T02:46:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.761+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ea00d0bf0 con 0x7f0ea006bf80 2024-04-13T02:46:05.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.763+0000 7f0e957fa640 1 -- 172.21.15.114:0/670438696 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+18648 (secure 0 0 0) 0x7f0e9007b0e0 con 0x7f0ea006bf80 2024-04-13T02:46:05.764 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:05.764 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:46:00.091000+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-04-13T02:45:43.069443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/2419206521":"2024-04-14T02:46:00.090906+0000","172.21.15.114:6835/2419206521":"2024-04-14T02:46:00.090906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e8c06c920 msgr2=0x7f0e8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e8c06c920 0x7f0e8c06ede0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c000f60 tx=0x7f0e9c009040 comp rx=0 tx=0).stop 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 msgr2=0x7f0ea00b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 0x7f0ea00b2420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0e9002b930 tx=0x7f0e900046c0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 shutdown_connections 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ea0162e70 0x7f0ea015e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea006bf80 0x7f0ea00b2420 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f0e8c06c920 0x7f0e8c06ede0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 --2- 172.21.15.114:0/670438696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ea006bba0 0x7f0ea0154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 >> 172.21.15.114:0/670438696 conn(0x7f0ea0073720 msgr2=0x7f0ea01551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 shutdown_connections 2024-04-13T02:46:05.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.765+0000 7f0ea6d1e640 1 -- 172.21.15.114:0/670438696 wait complete. 2024-04-13T02:46:05.777 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-13T02:46:05.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:46:05.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.875+0000 7fcd5c711640 1 Processor -- start 2024-04-13T02:46:05.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.875+0000 7fcd5c711640 1 -- start start 2024-04-13T02:46:05.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd5c711640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcd5409ae00 0x7fcd5409b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd5c711640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd540cedf0 0x7fcd54160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd5c711640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd5c711640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fcd54160520 con 0x7fcd540cedf0 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd5c711640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fcd540c95e0 con 0x7fcd5409ae00 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd5c711640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcd540d0320 con 0x7fcd5409b1e0 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd59cac640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd540cedf0 0x7fcd54160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd59cac640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd540cedf0 0x7fcd54160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57054/0 (socket says 172.21.15.114:57054) 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.876+0000 7fcd59cac640 1 -- 172.21.15.114:0/349612975 learned_addr learned my addr 172.21.15.114:0/349612975 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd5a4ad640 1 --2- 172.21.15.114:0/349612975 >> v2:172.21.15.130:3300/0 conn(0x7fcd5409ae00 0x7fcd5409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd5acae640 1 --2- 172.21.15.114:0/349612975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd59cac640 1 -- 172.21.15.114:0/349612975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 msgr2=0x7fcd540cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd59cac640 1 --2- 172.21.15.114:0/349612975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd59cac640 1 -- 172.21.15.114:0/349612975 >> v2:172.21.15.130:3300/0 conn(0x7fcd5409ae00 msgr2=0x7fcd5409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:05.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd59cac640 1 --2- 172.21.15.114:0/349612975 >> v2:172.21.15.130:3300/0 conn(0x7fcd5409ae00 0x7fcd5409b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd59cac640 1 -- 172.21.15.114:0/349612975 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd540d05e0 con 0x7fcd540cedf0 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.877+0000 7fcd59cac640 1 --2- 172.21.15.114:0/349612975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd540cedf0 0x7fcd54160f70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcd5406c700 tx=0x7fcd4402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520711a754152ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd594ab640 1 -- 172.21.15.114:0/349612975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4402e070 con 0x7fcd540cedf0 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd594ab640 1 -- 172.21.15.114:0/349612975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd44037070 con 0x7fcd540cedf0 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd594ab640 1 -- 172.21.15.114:0/349612975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd44031a00 con 0x7fcd540cedf0 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 -- 172.21.15.114:0/349612975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd540cedf0 msgr2=0x7fcd54160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 --2- 172.21.15.114:0/349612975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd540cedf0 0x7fcd54160f70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcd5406c700 tx=0x7fcd4402b880 comp rx=0 tx=0).stop 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 -- 172.21.15.114:0/349612975 shutdown_connections 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 --2- 172.21.15.114:0/349612975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 --2- 172.21.15.114:0/349612975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd540cedf0 0x7fcd54160f70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 --2- 172.21.15.114:0/349612975 >> v2:172.21.15.130:3300/0 conn(0x7fcd5409ae00 0x7fcd5409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 -- 172.21.15.114:0/349612975 >> 172.21.15.114:0/349612975 conn(0x7fcd540d2750 msgr2=0x7fcd540d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:05.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 -- 172.21.15.114:0/349612975 shutdown_connections 2024-04-13T02:46:05.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.878+0000 7fcd5c711640 1 -- 172.21.15.114:0/349612975 wait complete. 2024-04-13T02:46:05.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.879+0000 7fcd5c711640 1 Processor -- start 2024-04-13T02:46:05.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.879+0000 7fcd5c711640 1 -- start start 2024-04-13T02:46:05.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5c711640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 0x7fcd541e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5c711640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5c711640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd540cedf0 0x7fcd5415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5c711640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd540cd700 con 0x7fcd5409ae00 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5c711640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54160770 con 0x7fcd540cedf0 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5c711640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcd540cd880 con 0x7fcd5409b1e0 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 0x7fcd541e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 0x7fcd541e82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57068/0 (socket says 172.21.15.114:57068) 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 -- 172.21.15.114:0/1708473374 learned_addr learned my addr 172.21.15.114:0/1708473374 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5acae640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd540cedf0 0x7fcd5415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd59cac640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 -- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 msgr2=0x7fcd540caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 -- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd540cedf0 msgr2=0x7fcd5415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd540cedf0 0x7fcd5415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5a4ad640 1 -- 172.21.15.114:0/1708473374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd540cc820 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd5acae640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd540cedf0 0x7fcd5415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.880+0000 7fcd59cac640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.881+0000 7fcd5a4ad640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 0x7fcd541e82f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcd50007e60 tx=0x7fcd5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.881+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50014620 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.881+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd50019070 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.881+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd540cb780 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.881+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50014a00 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.881+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd540cbd40 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.882+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd54068c80 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.882+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd50014ba0 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.883+0000 7fcd4affd640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcd3806c8f0 0x7fcd3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.883+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7fcd5008c5b0 con 0x7fcd5409ae00 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.883+0000 7fcd59cac640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcd3806c8f0 0x7fcd3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.883+0000 7fcd59cac640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcd3806c8f0 0x7fcd3806edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd44036000 tx=0x7fcd44008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:05.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:05.887+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd5005a800 con 0x7fcd5409ae00 2024-04-13T02:46:06.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.098+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd540cc0e0 con 0x7fcd5409ae00 2024-04-13T02:46:06.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.098+0000 7fcd4affd640 1 -- 172.21.15.114:0/1708473374 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4366 (secure 0 0 0) 0x7fcd5005a100 con 0x7fcd5409ae00 2024-04-13T02:46:06.100 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:06.100 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:46:03.101888+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5079,"qdb_cluster":[5079]},"id":2}]} 2024-04-13T02:46:06.100 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-04-13T02:46:06.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcd3806c8f0 msgr2=0x7fcd3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcd3806c8f0 0x7fcd3806edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd44036000 tx=0x7fcd44008030 comp rx=0 tx=0).stop 2024-04-13T02:46:06.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 msgr2=0x7fcd541e82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 0x7fcd541e82f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcd50007e60 tx=0x7fcd5000e4b0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 shutdown_connections 2024-04-13T02:46:06.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd540cedf0 0x7fcd5415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcd3806c8f0 0x7fcd3806edb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcd5409b1e0 0x7fcd540caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 --2- 172.21.15.114:0/1708473374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd5409ae00 0x7fcd541e82f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 >> 172.21.15.114:0/1708473374 conn(0x7fcd540d2750 msgr2=0x7fcd54071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:06.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 shutdown_connections 2024-04-13T02:46:06.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.100+0000 7fcd5c711640 1 -- 172.21.15.114:0/1708473374 wait complete. 2024-04-13T02:46:06.112 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:46:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.212+0000 7fe52c5bb640 1 Processor -- start 2024-04-13T02:46:06.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.212+0000 7fe52c5bb640 1 -- start start 2024-04-13T02:46:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52c5bb640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5241552e0 0x7fe5240afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52c5bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 0x7fe5240cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52c5bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5240b48e0 con 0x7fe52415c170 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52c5bb640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe5240b38d0 con 0x7fe5241552e0 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52c5bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe5240b3b20 con 0x7fe524073180 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529b56640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe52415c170 0x7fe524072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52128/0 (socket says 172.21.15.114:52128) 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529b56640 1 -- 172.21.15.114:0/2461839093 learned_addr learned my addr 172.21.15.114:0/2461839093 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807609978 0 0) 0x7fe5240b48e0 con 0x7fe52415c170 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe510003520 con 0x7fe52415c170 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52a357640 1 --2- 172.21.15.114:0/2461839093 >> v2:172.21.15.130:3300/0 conn(0x7fe5241552e0 0x7fe5240afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe52ab58640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 0x7fe5240cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3335560699 0 0) 0x7fe510003520 con 0x7fe52415c170 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 msgr2=0x7fe5240cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 0x7fe5240cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 >> v2:172.21.15.130:3300/0 conn(0x7fe5241552e0 msgr2=0x7fe5240afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 --2- 172.21.15.114:0/2461839093 >> v2:172.21.15.130:3300/0 conn(0x7fe5241552e0 0x7fe5240afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5240b3e00 con 0x7fe52415c170 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fe514001670 con 0x7fe52415c170 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 >> v1:172.21.15.114:6789/0 conn(0x7fe52415c170 legacy=0x7fe524072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5100039b0 0x7fe510003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe510004800 0x7fe510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 0x7fe5100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5240b38d0 con 0x7fe510004800 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5240b3b20 con 0x7fe5100039b0 2024-04-13T02:46:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe51000b9c0 con 0x7fe524073180 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.213+0000 7fe529b56640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe510004800 0x7fe510004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe52a357640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5100039b0 0x7fe510003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe52ab58640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 0x7fe5100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe529b56640 1 -- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 msgr2=0x7fe5100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe529b56640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe524073180 0x7fe5100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe529b56640 1 -- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5100039b0 msgr2=0x7fe510003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe529b56640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5100039b0 0x7fe510003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe529b56640 1 -- 172.21.15.114:0/2461839093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe510003520 con 0x7fe510004800 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.214+0000 7fe529b56640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe510004800 0x7fe510004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe514007fd0 tx=0x7fe510005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7589c42bf936f987 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe514007d50 con 0x7fe510004800 2024-04-13T02:46:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe514030070 con 0x7fe510004800 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe529355640 1 -- 172.21.15.114:0/2461839093 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51402cd40 con 0x7fe510004800 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52c5bb640 1 -- 172.21.15.114:0/2461839093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe510004800 msgr2=0x7fe510004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/2461839093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe510004800 0x7fe510004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe514007fd0 tx=0x7fe510005830 comp rx=0 tx=0).stop 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52ab58640 1 -- 172.21.15.114:0/2461839093 reap_dead start 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52c5bb640 1 -- 172.21.15.114:0/2461839093 shutdown_connections 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52c5bb640 1 -- 172.21.15.114:0/2461839093 >> 172.21.15.114:0/2461839093 conn(0x7fe5240b27b0 msgr2=0x7fe5240b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52c5bb640 1 -- 172.21.15.114:0/2461839093 shutdown_connections 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.215+0000 7fe52c5bb640 1 -- 172.21.15.114:0/2461839093 wait complete. 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.216+0000 7fe52c5bb640 1 Processor -- start 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.216+0000 7fe52c5bb640 1 -- start start 2024-04-13T02:46:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52c5bb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe510004800 0x7fe5241477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52c5bb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe52414f6d0 0x7fe5240af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52c5bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 0x7fe5240ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52c5bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5240b00a0 con 0x7fe5240af8d0 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52c5bb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5240b43c0 con 0x7fe510004800 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52c5bb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe5240b0220 con 0x7fe52414f6d0 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 0x7fe5240ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 0x7fe5240ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57090/0 (socket says 172.21.15.114:57090) 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 -- 172.21.15.114:0/3178531052 learned_addr learned my addr 172.21.15.114:0/3178531052 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52a357640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe510004800 0x7fe5241477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe529b56640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe52414f6d0 0x7fe5240af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 -- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe52414f6d0 msgr2=0x7fe5240af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe52414f6d0 0x7fe5240af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 -- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe510004800 msgr2=0x7fe5241477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe510004800 0x7fe5241477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52ab58640 1 -- 172.21.15.114:0/3178531052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5240ae5a0 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe52a357640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe510004800 0x7fe5241477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.217+0000 7fe529b56640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe52414f6d0 0x7fe5240af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.218+0000 7fe52ab58640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 0x7fe5240ad8b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe5240ced70 tx=0x7fe51c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.218+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00fd80 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.218+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe51c01d070 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.218+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52414ebf0 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.218+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c015670 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.218+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52414f1b0 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.219+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe524068c80 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.219+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe51c015810 con 0x7fe5240af8d0 2024-04-13T02:46:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.220+0000 7fe51affd640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe50806c920 0x7fe50806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.220+0000 7fe52a357640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe50806c920 0x7fe50806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.220+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7fe51c08c510 con 0x7fe5240af8d0 2024-04-13T02:46:06.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.220+0000 7fe52a357640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe50806c920 0x7fe50806ede0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe520009ab0 tx=0x7fe520008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.224+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe51c010040 con 0x7fe5240af8d0 2024-04-13T02:46:06.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.433+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe52414f380 con 0x7fe5240af8d0 2024-04-13T02:46:06.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.434+0000 7fe51affd640 1 -- 172.21.15.114:0/3178531052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4366 (secure 0 0 0) 0x7fe51c05a760 con 0x7fe5240af8d0 2024-04-13T02:46:06.436 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:06.436 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-13T02:45:27.799553+0000","modified":"2024-04-13T02:46:03.101888+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5079},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5079":{"gid":5079,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":13,"addr":"172.21.15.114:6836/3142738723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3142738723},{"type":"v1","addr":"172.21.15.114:6836","nonce":3142738723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5079,"qdb_cluster":[5079]},"id":2}]} 2024-04-13T02:46:06.436 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe50806c920 msgr2=0x7fe50806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe50806c920 0x7fe50806ede0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe520009ab0 tx=0x7fe520008040 comp rx=0 tx=0).stop 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 msgr2=0x7fe5240ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 0x7fe5240ad8b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe5240ced70 tx=0x7fe51c00f580 comp rx=0 tx=0).stop 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 shutdown_connections 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5240af8d0 0x7fe5240ad8b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe50806c920 0x7fe50806ede0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe52414f6d0 0x7fe5240af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 --2- 172.21.15.114:0/3178531052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe510004800 0x7fe5241477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 >> 172.21.15.114:0/3178531052 conn(0x7fe5240b27b0 msgr2=0x7fe52415c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 shutdown_connections 2024-04-13T02:46:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.436+0000 7fe52c5bb640 1 -- 172.21.15.114:0/3178531052 wait complete. 2024-04-13T02:46:06.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:46:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.546+0000 7f2d290c8640 1 Processor -- start 2024-04-13T02:46:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.547+0000 7f2d290c8640 1 -- start start 2024-04-13T02:46:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.547+0000 7f2d290c8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2d240d1300 0x7f2d240d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.547+0000 7f2d290c8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d240d2d90 con 0x7f2d240b3470 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.547+0000 7f2d290c8640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d240d3070 con 0x7f2d2415eac0 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.547+0000 7f2d290c8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2d240d1cd0 con 0x7f2d240d1300 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.547+0000 7f2d2359e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2d240b3470 0x7f2d240b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52130/0 (socket says 172.21.15.114:52130) 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d2359e640 1 -- 172.21.15.114:0/3989457516 learned_addr learned my addr 172.21.15.114:0/3989457516 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062390441 0 0) 0x7f2d240d2d90 con 0x7f2d240b3470 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d10003520 con 0x7f2d240b3470 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d2259c640 1 --2- 172.21.15.114:0/3989457516 >> v2:172.21.15.130:3300/0 conn(0x7f2d240d1300 0x7f2d240d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693358129 0 0) 0x7f2d10003520 con 0x7f2d240b3470 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 >> v2:172.21.15.130:3300/0 conn(0x7f2d240d1300 msgr2=0x7f2d240d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 --2- 172.21.15.114:0/3989457516 >> v2:172.21.15.130:3300/0 conn(0x7f2d240d1300 0x7f2d240d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 >> v1:172.21.15.130:6789/0 conn(0x7f2d2415eac0 legacy=0x7f2d240d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d240d3350 con 0x7f2d240b3470 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f2d14001670 con 0x7f2d240b3470 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 >> v1:172.21.15.114:6789/0 conn(0x7f2d240b3470 legacy=0x7f2d240b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d10004800 0x7f2d10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d100051c0 0x7f2d1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d240d1cd0 con 0x7f2d100039b0 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1000c060 con 0x7f2d10004800 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1000c260 con 0x7f2d100051c0 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d2359e640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d100051c0 0x7f2d1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d2259c640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d10004800 0x7f2d10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d100051c0 msgr2=0x7f2d1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d100051c0 0x7f2d1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d10004800 msgr2=0x7f2d10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d10004800 0x7f2d10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d2359e640 1 -- 172.21.15.114:0/3989457516 reap_dead start 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.548+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3989457516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d10003520 con 0x7f2d100039b0 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.549+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d10003dd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c001e50 tx=0x7f2d10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820b6d427038ac03 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.549+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c001a70 con 0x7f2d100039b0 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.549+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c003b70 con 0x7f2d100039b0 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.549+0000 7f2d21d9b640 1 -- 172.21.15.114:0/3989457516 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0050d0 con 0x7f2d100039b0 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 -- 172.21.15.114:0/3989457516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 msgr2=0x7f2d10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d10003dd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c001e50 tx=0x7f2d10005830 comp rx=0 tx=0).stop 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 -- 172.21.15.114:0/3989457516 shutdown_connections 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3989457516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d10003dd0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 -- 172.21.15.114:0/3989457516 >> 172.21.15.114:0/3989457516 conn(0x7f2d24073690 msgr2=0x7f2d2406cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 -- 172.21.15.114:0/3989457516 shutdown_connections 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.550+0000 7f2d290c8640 1 -- 172.21.15.114:0/3989457516 wait complete. 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.551+0000 7f2d290c8640 1 Processor -- start 2024-04-13T02:46:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.551+0000 7f2d290c8640 1 -- start start 2024-04-13T02:46:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d290c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d241539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d290c8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2415ac40 0x7f2d240cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d290c8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2415b0c0 0x7f2d240ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d290c8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2415eea0 con 0x7f2d100039b0 2024-04-13T02:46:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d290c8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d240d3910 con 0x7f2d2415b0c0 2024-04-13T02:46:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d290c8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d240d29f0 con 0x7f2d2415ac40 2024-04-13T02:46:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d241539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d241539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57114/0 (socket says 172.21.15.114:57114) 2024-04-13T02:46:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3684511470 learned_addr learned my addr 172.21.15.114:0/3684511470 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d2259c640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2415ac40 0x7f2d240cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d2359e640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2415b0c0 0x7f2d240ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2415ac40 msgr2=0x7f2d240cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2415ac40 0x7f2d240cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2415b0c0 msgr2=0x7f2d240ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2415b0c0 0x7f2d240ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.552+0000 7f2d22d9d640 1 -- 172.21.15.114:0/3684511470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d24147970 con 0x7f2d100039b0 2024-04-13T02:46:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.553+0000 7f2d22d9d640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d241539d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005040 tx=0x7f2d1c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.553+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c003970 con 0x7f2d100039b0 2024-04-13T02:46:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.553+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c006b50 con 0x7f2d100039b0 2024-04-13T02:46:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.553+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2415a160 con 0x7f2d100039b0 2024-04-13T02:46:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.553+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c007030 con 0x7f2d100039b0 2024-04-13T02:46:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.553+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2415a720 con 0x7f2d100039b0 2024-04-13T02:46:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.554+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d24068c80 con 0x7f2d100039b0 2024-04-13T02:46:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.554+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d1c0071d0 con 0x7f2d100039b0 2024-04-13T02:46:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.554+0000 7f2d1b7fe640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0406c920 0x7f2d0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.555+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7f2d1c0ad960 con 0x7f2d100039b0 2024-04-13T02:46:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.555+0000 7f2d2259c640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0406c920 0x7f2d0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.555+0000 7f2d2259c640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0406c920 0x7f2d0406ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d2415c210 tx=0x7f2d0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.559+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d1c033020 con 0x7f2d100039b0 2024-04-13T02:46:06.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.736+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d2415bba0 con 0x7f2d100039b0 2024-04-13T02:46:06.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.737+0000 7f2d1b7fe640 1 -- 172.21.15.114:0/3684511470 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+18648 (secure 0 0 0) 0x7f2d1c07bbb0 con 0x7f2d100039b0 2024-04-13T02:46:06.739 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:06.739 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:46:00.091000+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-13T02:45:26.236118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-13T02:45:26.746769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-04-13T02:45:43.069443+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/2419206521":"2024-04-14T02:46:00.090906+0000","172.21.15.114:6835/2419206521":"2024-04-14T02:46:00.090906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0406c920 msgr2=0x7f2d0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0406c920 0x7f2d0406ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d2415c210 tx=0x7f2d0c008040 comp rx=0 tx=0).stop 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 msgr2=0x7f2d241539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d241539d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005040 tx=0x7f2d1c0014a0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 shutdown_connections 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2415b0c0 0x7f2d240ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f2d0406c920 0x7f2d0406ede0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2415ac40 0x7f2d240cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 --2- 172.21.15.114:0/3684511470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d100039b0 0x7f2d241539d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 >> 172.21.15.114:0/3684511470 conn(0x7f2d24073690 msgr2=0x7f2d240d3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 shutdown_connections 2024-04-13T02:46:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.739+0000 7f2d290c8640 1 -- 172.21.15.114:0/3684511470 wait complete. 2024-04-13T02:46:06.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-13T02:46:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.851+0000 7ff248fe9640 1 Processor -- start 2024-04-13T02:46:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.851+0000 7ff248fe9640 1 -- start start 2024-04-13T02:46:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff248fe9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff24415ec40 0x7ff2440d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff248fe9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff2440d2c30 0x7ff2440ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff248fe9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2440ba8d0 con 0x7ff2440d1300 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff248fe9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff2440d3090 con 0x7ff24415ec40 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff248fe9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff2440d32c0 con 0x7ff2440d2c30 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff24259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff24415ec40 0x7ff2440d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff24259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff24415ec40 0x7ff2440d4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57124/0 (socket says 172.21.15.114:57124) 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff24259c640 1 -- 172.21.15.114:0/262540831 learned_addr learned my addr 172.21.15.114:0/262540831 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.852+0000 7ff241d9b640 1 --2- 172.21.15.114:0/262540831 >> v2:172.21.15.130:3300/0 conn(0x7ff2440d2c30 0x7ff2440ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24259c640 1 -- 172.21.15.114:0/262540831 >> v2:172.21.15.130:3300/0 conn(0x7ff2440d2c30 msgr2=0x7ff2440ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24259c640 1 --2- 172.21.15.114:0/262540831 >> v2:172.21.15.130:3300/0 conn(0x7ff2440d2c30 0x7ff2440ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24259c640 1 -- 172.21.15.114:0/262540831 >> v1:172.21.15.130:6789/0 conn(0x7ff2440d1300 legacy=0x7ff2440b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24259c640 1 -- 172.21.15.114:0/262540831 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2440d35a0 con 0x7ff24415ec40 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24259c640 1 --2- 172.21.15.114:0/262540831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff24415ec40 0x7ff2440d4360 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff2440d59a0 tx=0x7ff23402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeed963604c3566 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24159a640 1 -- 172.21.15.114:0/262540831 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23402ca80 con 0x7ff24415ec40 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24159a640 1 -- 172.21.15.114:0/262540831 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23402cc20 con 0x7ff24415ec40 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.853+0000 7ff24159a640 1 -- 172.21.15.114:0/262540831 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2340343f0 con 0x7ff24415ec40 2024-04-13T02:46:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 -- 172.21.15.114:0/262540831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff24415ec40 msgr2=0x7ff2440d4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 --2- 172.21.15.114:0/262540831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff24415ec40 0x7ff2440d4360 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff2440d59a0 tx=0x7ff23402bee0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 -- 172.21.15.114:0/262540831 shutdown_connections 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 --2- 172.21.15.114:0/262540831 >> v2:172.21.15.130:3300/0 conn(0x7ff2440d2c30 0x7ff2440ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 --2- 172.21.15.114:0/262540831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff24415ec40 0x7ff2440d4360 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 -- 172.21.15.114:0/262540831 >> 172.21.15.114:0/262540831 conn(0x7ff244073690 msgr2=0x7ff24406cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 -- 172.21.15.114:0/262540831 shutdown_connections 2024-04-13T02:46:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.854+0000 7ff248fe9640 1 -- 172.21.15.114:0/262540831 wait complete. 2024-04-13T02:46:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.855+0000 7ff248fe9640 1 Processor -- start 2024-04-13T02:46:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.855+0000 7ff248fe9640 1 -- start start 2024-04-13T02:46:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff248fe9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2440d1300 0x7ff2440ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff248fe9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 0x7ff2441f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff248fe9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff24415ec40 0x7ff2441f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff248fe9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2440d3e40 con 0x7ff2440d2c30 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff248fe9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff2440d3b60 con 0x7ff2440d1300 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff248fe9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2440d1770 con 0x7ff24415ec40 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff241d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 0x7ff2441f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff241d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 0x7ff2441f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57130/0 (socket says 172.21.15.114:57130) 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.856+0000 7ff241d9b640 1 -- 172.21.15.114:0/1376652008 learned_addr learned my addr 172.21.15.114:0/1376652008 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff24259c640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2440d1300 0x7ff2440ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff241d9b640 1 -- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff24415ec40 msgr2=0x7ff2441f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff241d9b640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff24415ec40 0x7ff2441f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff241d9b640 1 -- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2440d1300 msgr2=0x7ff2440ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff241d9b640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2440d1300 0x7ff2440ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff241d9b640 1 -- 172.21.15.114:0/1376652008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2440cc7e0 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff24259c640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2440d1300 0x7ff2440ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff241d9b640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 0x7ff2441f71c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff23800d800 tx=0x7ff23800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23800b6c0 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff238019070 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2440ccac0 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23800ba80 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.857+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2440cd080 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.858+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2440d1b30 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.858+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff23800bc20 con 0x7ff2440d2c30 2024-04-13T02:46:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.859+0000 7ff232ffd640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff22406c8f0 0x7ff22406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.859+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6190+0+0 (secure 0 0 0) 0x7ff23808c1e0 con 0x7ff2440d2c30 2024-04-13T02:46:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.859+0000 7ff24259c640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff22406c8f0 0x7ff22406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.859+0000 7ff24259c640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff22406c8f0 0x7ff22406edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff234035000 tx=0x7ff234030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:06.863+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2440d1b30 con 0x7ff2440d2c30 2024-04-13T02:46:07.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.073+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff244068c80 con 0x7ff2440d2c30 2024-04-13T02:46:07.075 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-04-13T02:46:07.073+0000 7fd07ee8a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-13T02:46:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.075+0000 7ff232ffd640 1 -- 172.21.15.114:0/1376652008 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7ff238011340 con 0x7ff2440d2c30 2024-04-13T02:46:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff22406c8f0 msgr2=0x7ff22406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff22406c8f0 0x7ff22406edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff234035000 tx=0x7ff234030000 comp rx=0 tx=0).stop 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 msgr2=0x7ff2441f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 0x7ff2441f71c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff23800d800 tx=0x7ff23800dcc0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 shutdown_connections 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff22406c8f0 0x7ff22406edb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff24415ec40 0x7ff2441f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2440d2c30 0x7ff2441f71c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 --2- 172.21.15.114:0/1376652008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2440d1300 0x7ff2440ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 >> 172.21.15.114:0/1376652008 conn(0x7ff244073690 msgr2=0x7ff2440cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 shutdown_connections 2024-04-13T02:46:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.077+0000 7ff248fe9640 1 -- 172.21.15.114:0/1376652008 wait complete. 2024-04-13T02:46:07.081 INFO:tasks.ceph.mds.c.smithi114.stderr: -185> 2024-04-13T02:46:03.424+0000 7fad7e7f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-13T02:46:07.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-13T02:46:07.106 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-04-13T02:46:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.194+0000 7f6de3e77640 1 Processor -- start 2024-04-13T02:46:07.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.194+0000 7f6de3e77640 1 -- start start 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de3e77640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6ddc0ce650 0x7f6ddc09ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de3e77640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ddc0703d0 0x7f6ddc09b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de3e77640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ddc071330 con 0x7f6ddc06d2e0 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de3e77640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6ddc09bb40 con 0x7f6ddc0703d0 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de3e77640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f6ddc06ce50 con 0x7f6ddc0ce650 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de1412640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ddc0703d0 0x7f6ddc09b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de2414640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6ddc06d2e0 0x7f6ddc06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52136/0 (socket says 172.21.15.114:52136) 2024-04-13T02:46:07.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de1412640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ddc0703d0 0x7f6ddc09b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57166/0 (socket says 172.21.15.114:57166) 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de2414640 1 -- 172.21.15.114:0/3677286910 learned_addr learned my addr 172.21.15.114:0/3677286910 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.195+0000 7f6de1c13640 1 --2- 172.21.15.114:0/3677286910 >> v2:172.21.15.130:3300/0 conn(0x7f6ddc0ce650 0x7f6ddc09ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de1412640 1 -- 172.21.15.114:0/3677286910 >> v2:172.21.15.130:3300/0 conn(0x7f6ddc0ce650 msgr2=0x7f6ddc09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de1412640 1 --2- 172.21.15.114:0/3677286910 >> v2:172.21.15.130:3300/0 conn(0x7f6ddc0ce650 0x7f6ddc09ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de1412640 1 -- 172.21.15.114:0/3677286910 >> v1:172.21.15.114:6789/0 conn(0x7f6ddc06d2e0 legacy=0x7f6ddc06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de1412640 1 -- 172.21.15.114:0/3677286910 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc06cae0 con 0x7f6ddc0703d0 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de1412640 1 --2- 172.21.15.114:0/3677286910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc09b060 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0b5350 tx=0x7f6dcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d01c5834a97cf1b server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de0c11640 1 -- 172.21.15.114:0/3677286910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc035020 con 0x7f6ddc0703d0 2024-04-13T02:46:07.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de0c11640 1 -- 172.21.15.114:0/3677286910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dcc031830 con 0x7f6ddc0703d0 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.196+0000 7f6de0c11640 1 -- 172.21.15.114:0/3677286910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc031c00 con 0x7f6ddc0703d0 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 -- 172.21.15.114:0/3677286910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0703d0 msgr2=0x7f6ddc09b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 --2- 172.21.15.114:0/3677286910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc09b060 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0b5350 tx=0x7f6dcc02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 -- 172.21.15.114:0/3677286910 shutdown_connections 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 --2- 172.21.15.114:0/3677286910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc09b060 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 --2- 172.21.15.114:0/3677286910 >> v2:172.21.15.130:3300/0 conn(0x7f6ddc0ce650 0x7f6ddc09ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 -- 172.21.15.114:0/3677286910 >> 172.21.15.114:0/3677286910 conn(0x7f6ddc0d2720 msgr2=0x7f6ddc0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 -- 172.21.15.114:0/3677286910 shutdown_connections 2024-04-13T02:46:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.197+0000 7f6de3e77640 1 -- 172.21.15.114:0/3677286910 wait complete. 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.198+0000 7f6de3e77640 1 Processor -- start 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.198+0000 7f6de3e77640 1 -- start start 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de3e77640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ddc06d2e0 0x7f6ddc1f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de3e77640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de3e77640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 0x7f6ddc0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de3e77640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc09bd90 con 0x7f6ddc0ce650 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de3e77640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc071610 con 0x7f6ddc0703d0 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de3e77640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc0cea30 con 0x7f6ddc06d2e0 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 0x7f6ddc0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 0x7f6ddc0cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57178/0 (socket says 172.21.15.114:57178) 2024-04-13T02:46:07.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 -- 172.21.15.114:0/2410485145 learned_addr learned my addr 172.21.15.114:0/2410485145 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de1c13640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ddc06d2e0 0x7f6ddc1f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de1412640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 -- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ddc06d2e0 msgr2=0x7f6ddc1f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ddc06d2e0 0x7f6ddc1f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 -- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ddc0703d0 msgr2=0x7f6ddc0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 -- 172.21.15.114:0/2410485145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc0c9aa0 con 0x7f6ddc0ce650 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6de2414640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 0x7f6ddc0cac40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400cbc0 tx=0x7f6dd400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:07.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.199+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4017070 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.200+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd400ad40 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.200+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc0cd420 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.200+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4012600 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.200+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc0cd9e0 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.201+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ddc09efb0 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.201+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dd401a070 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.201+0000 7f6dd27fc640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6dc006c8f0 0x7f6dc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.202+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6276+0+0 (secure 0 0 0) 0x7f6dd408ba20 con 0x7f6ddc0ce650 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.202+0000 7f6de1c13640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6dc006c8f0 0x7f6dc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:07.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.202+0000 7f6de1c13640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6dc006c8f0 0x7f6dc006edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006fd0 tx=0x7f6dd8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.206+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ddc09efb0 con 0x7f6ddc0ce650 2024-04-13T02:46:07.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:07.421+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6ddc0718a0 con 0x7f6ddc0ce650 2024-04-13T02:46:08.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.076+0000 7f6dd27fc640 1 -- 172.21.15.114:0/2410485145 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f6dd40595c0 con 0x7f6ddc0ce650 2024-04-13T02:46:08.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6dc006c8f0 msgr2=0x7f6dc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6dc006c8f0 0x7f6dc006edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006fd0 tx=0x7f6dd8008040 comp rx=0 tx=0).stop 2024-04-13T02:46:08.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 msgr2=0x7f6ddc0cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 0x7f6ddc0cac40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400cbc0 tx=0x7f6dd400a430 comp rx=0 tx=0).stop 2024-04-13T02:46:08.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 shutdown_connections 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ddc0ce650 0x7f6ddc0cac40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ddc0703d0 0x7f6ddc0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6dc006c8f0 0x7f6dc006edb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 --2- 172.21.15.114:0/2410485145 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ddc06d2e0 0x7f6ddc1f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 >> 172.21.15.114:0/2410485145 conn(0x7f6ddc0d2720 msgr2=0x7f6ddc0af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 shutdown_connections 2024-04-13T02:46:08.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.079+0000 7f6de3e77640 1 -- 172.21.15.114:0/2410485145 wait complete. 2024-04-13T02:46:08.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-13T02:46:08.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.241+0000 7fe5c241c640 1 Processor -- start 2024-04-13T02:46:08.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.241+0000 7fe5c241c640 1 -- start start 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.241+0000 7fe5c241c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5bc15fdb0 0x7fe5bc06f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.241+0000 7fe5c241c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5bc160190 con 0x7fe5bc0cfe30 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.241+0000 7fe5c241c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5bc0d04e0 con 0x7fe5bc06f7b0 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.241+0000 7fe5c241c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe5bc072b90 con 0x7fe5bc15fdb0 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5c09b9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe5bc0cfe30 0x7fe5bc15bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52146/0 (socket says 172.21.15.114:52146) 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5c09b9640 1 -- 172.21.15.114:0/842806488 learned_addr learned my addr 172.21.15.114:0/842806488 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5bbfff640 1 --2- 172.21.15.114:0/842806488 >> v2:172.21.15.130:3300/0 conn(0x7fe5bc15fdb0 0x7fe5bc06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731091010 0 0) 0x7fe5bc160190 con 0x7fe5bc0cfe30 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5a4003520 con 0x7fe5bc0cfe30 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2204480492 0 0) 0x7fe5a4003520 con 0x7fe5bc0cfe30 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 >> v2:172.21.15.130:3300/0 conn(0x7fe5bc15fdb0 msgr2=0x7fe5bc06f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 --2- 172.21.15.114:0/842806488 >> v2:172.21.15.130:3300/0 conn(0x7fe5bc15fdb0 0x7fe5bc06f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 >> v1:172.21.15.130:6789/0 conn(0x7fe5bc06f7b0 legacy=0x7fe5bc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc073020 con 0x7fe5bc0cfe30 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fe5b40019f0 con 0x7fe5bc0cfe30 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 >> v1:172.21.15.114:6789/0 conn(0x7fe5bc0cfe30 legacy=0x7fe5bc15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a40039b0 0x7fe5a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5a4004800 0x7fe5a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a40051c0 0x7fe5a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc072b90 con 0x7fe5a4004800 2024-04-13T02:46:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a400c060 con 0x7fe5a40051c0 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a400c260 con 0x7fe5a40039b0 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5a4004800 0x7fe5a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5c09b9640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a40051c0 0x7fe5a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.242+0000 7fe5bbfff640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a40039b0 0x7fe5a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a40039b0 msgr2=0x7fe5a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a40039b0 0x7fe5a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a40051c0 msgr2=0x7fe5a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5a40051c0 0x7fe5a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/842806488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a4003520 con 0x7fe5a4004800 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5c09b9640 1 -- 172.21.15.114:0/842806488 reap_dead start 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5a4004800 0x7fe5a4004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001750 tx=0x7fe5a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d092f918fff732a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0001370 con 0x7fe5a4004800 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b00052d0 con 0x7fe5a4004800 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.243+0000 7fe5baffd640 1 -- 172.21.15.114:0/842806488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0003830 con 0x7fe5a4004800 2024-04-13T02:46:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 -- 172.21.15.114:0/842806488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5a4004800 msgr2=0x7fe5a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5a4004800 0x7fe5a4004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001750 tx=0x7fe5a4005830 comp rx=0 tx=0).stop 2024-04-13T02:46:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 -- 172.21.15.114:0/842806488 shutdown_connections 2024-04-13T02:46:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 --2- 172.21.15.114:0/842806488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5a4004800 0x7fe5a4004c80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 -- 172.21.15.114:0/842806488 >> 172.21.15.114:0/842806488 conn(0x7fe5bc0b2460 msgr2=0x7fe5bc0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 -- 172.21.15.114:0/842806488 shutdown_connections 2024-04-13T02:46:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.244+0000 7fe5c241c640 1 -- 172.21.15.114:0/842806488 wait complete. 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.245+0000 7fe5c241c640 1 Processor -- start 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.245+0000 7fe5c241c640 1 -- start start 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c241c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a4004800 0x7fe5bc1e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c241c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 0x7fe5bc0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c241c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06e160 0x7fe5bc06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c241c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc072260 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c241c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc0d0280 con 0x7fe5bc06e160 2024-04-13T02:46:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c241c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe5bc072540 con 0x7fe5a4004800 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 0x7fe5bc0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 0x7fe5bc0af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57202/0 (socket says 172.21.15.114:57202) 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/338656211 learned_addr learned my addr 172.21.15.114:0/338656211 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c09b9640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06e160 0x7fe5bc06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bbfff640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a4004800 0x7fe5bc1e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a4004800 msgr2=0x7fe5bc1e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a4004800 0x7fe5bc1e4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06e160 msgr2=0x7fe5bc06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06e160 0x7fe5bc06e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 -- 172.21.15.114:0/338656211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc1e5580 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5c09b9640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06e160 0x7fe5bc06e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.246+0000 7fe5bb7fe640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 0x7fe5bc0af4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000c00 tx=0x7fe5b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.247+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0041020 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.247+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b0005480 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.247+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5bc1e5860 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.247+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0007a30 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.247+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5bc1e5e20 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.248+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5bc068db0 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.248+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5b0044020 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.248+0000 7fe5b8ff9640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe5a806c8f0 0x7fe5a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.249+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6276+0+0 (secure 0 0 0) 0x7fe5b00ad8a0 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.249+0000 7fe5bbfff640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe5a806c8f0 0x7fe5a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.249+0000 7fe5bbfff640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe5a806c8f0 0x7fe5a806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0701e0 tx=0x7fe5ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.254+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe5b004b030 con 0x7fe5bc1e70e0 2024-04-13T02:46:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:08.429+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe5bc072810 con 0x7fe5bc1e70e0 2024-04-13T02:46:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.137+0000 7fe5b8ff9640 1 -- 172.21.15.114:0/338656211 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7fe5b00303c0 con 0x7fe5bc1e70e0 2024-04-13T02:46:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-04-13T02:46:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe5a806c8f0 msgr2=0x7fe5a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe5a806c8f0 0x7fe5a806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0701e0 tx=0x7fe5ac008040 comp rx=0 tx=0).stop 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 msgr2=0x7fe5bc0af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 0x7fe5bc0af4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000c00 tx=0x7fe5b0001120 comp rx=0 tx=0).stop 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 shutdown_connections 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5bc06e160 0x7fe5bc06e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5bc1e70e0 0x7fe5bc0af4c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe5a806c8f0 0x7fe5a806edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 --2- 172.21.15.114:0/338656211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5a4004800 0x7fe5bc1e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 >> 172.21.15.114:0/338656211 conn(0x7fe5bc0b2460 msgr2=0x7fe5bc15d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 shutdown_connections 2024-04-13T02:46:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.140+0000 7fe5c241c640 1 -- 172.21.15.114:0/338656211 wait complete. 2024-04-13T02:46:09.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-13T02:46:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.257+0000 7fdff52b7640 1 Processor -- start 2024-04-13T02:46:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.257+0000 7fdff52b7640 1 -- start start 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.258+0000 7fdff52b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 0x7fdff00b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.258+0000 7fdff52b7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff00b6850 con 0x7fdff0148410 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.258+0000 7fdff52b7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff0162890 con 0x7fdff00d1cd0 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.258+0000 7fdff52b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdff0162640 con 0x7fdff0163370 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.258+0000 7fdfeeffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdff0148410 0x7fdff0070e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53200/0 (socket says 172.21.15.114:53200) 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.258+0000 7fdfeeffd640 1 -- 172.21.15.114:0/2721800103 learned_addr learned my addr 172.21.15.114:0/2721800103 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 0x7fdff00b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924813400 0 0) 0x7fdff00b6850 con 0x7fdff0148410 2024-04-13T02:46:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd8003520 con 0x7fdff0148410 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260184575 0 0) 0x7fdff0162890 con 0x7fdff00d1cd0 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdff00b6850 con 0x7fdff00d1cd0 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2654888984 0 0) 0x7fdfd8003520 con 0x7fdff0148410 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 msgr2=0x7fdff00b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 0x7fdff00b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 >> v1:172.21.15.130:6789/0 conn(0x7fdff00d1cd0 legacy=0x7fdff006f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff0162b70 con 0x7fdff0148410 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fdfe00019f0 con 0x7fdff0148410 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 >> v1:172.21.15.114:6789/0 conn(0x7fdff0148410 legacy=0x7fdff0070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 0x7fdfd8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd80040d0 0x7fdfd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd8004d40 0x7fdfd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdff0162640 con 0x7fdfd80040d0 2024-04-13T02:46:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd800bb50 con 0x7fdfd8004d40 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd800bd20 con 0x7fdff0163370 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd80040d0 0x7fdfd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfeeffd640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 0x7fdfd8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfef7fe640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd8004d40 0x7fdfd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 -- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 msgr2=0x7fdfd8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdff0163370 0x7fdfd8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 -- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd8004d40 msgr2=0x7fdfd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd8004d40 0x7fdfd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.259+0000 7fdfee7fc640 1 -- 172.21.15.114:0/2721800103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd8003520 con 0x7fdfd80040d0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.260+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd80040d0 0x7fdfd8004800 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009ac0 tx=0x7fdfd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76aed2b2445c0115 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.260+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4039070 con 0x7fdfd80040d0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.260+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe402c6b0 con 0x7fdfd80040d0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.260+0000 7fdfedffb640 1 -- 172.21.15.114:0/2721800103 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4009690 con 0x7fdfd80040d0 2024-04-13T02:46:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdff52b7640 1 -- 172.21.15.114:0/2721800103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd80040d0 msgr2=0x7fdfd8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdff52b7640 1 --2- 172.21.15.114:0/2721800103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd80040d0 0x7fdfd8004800 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009ac0 tx=0x7fdfd8005830 comp rx=0 tx=0).stop 2024-04-13T02:46:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdfef7fe640 1 -- 172.21.15.114:0/2721800103 reap_dead start 2024-04-13T02:46:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdff52b7640 1 -- 172.21.15.114:0/2721800103 shutdown_connections 2024-04-13T02:46:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdff52b7640 1 -- 172.21.15.114:0/2721800103 >> 172.21.15.114:0/2721800103 conn(0x7fdff009aa40 msgr2=0x7fdff009ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdff52b7640 1 -- 172.21.15.114:0/2721800103 shutdown_connections 2024-04-13T02:46:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.261+0000 7fdff52b7640 1 -- 172.21.15.114:0/2721800103 wait complete. 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.262+0000 7fdff52b7640 1 Processor -- start 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.262+0000 7fdff52b7640 1 -- start start 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd80040d0 0x7fdff0142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00b2f50 0x7fdff00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 0x7fdff00cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00b62f0 con 0x7fdff00b33d0 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00b6170 con 0x7fdff00b2f50 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdff00b6470 con 0x7fdfd80040d0 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 0x7fdff00cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 0x7fdff00cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34200/0 (socket says 172.21.15.114:34200) 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 -- 172.21.15.114:0/3196641884 learned_addr learned my addr 172.21.15.114:0/3196641884 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 -- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd80040d0 msgr2=0x7fdff0142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd80040d0 0x7fdff0142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 -- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00b2f50 msgr2=0x7fdff00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00b2f50 0x7fdff00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00b2f50 0x7fdff00caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 -- 172.21.15.114:0/3196641884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff00b1eb0 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfee7fc640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00b2f50 0x7fdff00caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfef7fe640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 0x7fdff00cafd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdff00b5640 tx=0x7fdfe800f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8019070 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8006aa0 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.263+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff00b2190 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.264+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8005030 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.264+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff00b2750 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.265+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff0068db0 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.265+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfe801c070 con 0x7fdff00b33d0 2024-04-13T02:46:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.265+0000 7fdfd77fe640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdfdc06c920 0x7fdfdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.265+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5838+0+0 (secure 0 0 0) 0x7fdfe808aa90 con 0x7fdff00b33d0 2024-04-13T02:46:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.265+0000 7fdfeeffd640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdfdc06c920 0x7fdfdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.266+0000 7fdfeeffd640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdfdc06c920 0x7fdfdc06ede0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0002000 tx=0x7fdfe0001f10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.270+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfe8058e40 con 0x7fdff00b33d0 2024-04-13T02:46:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:09.444+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdff00d1ab0 con 0x7fdff00b33d0 2024-04-13T02:46:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.150+0000 7fdfd77fe640 1 -- 172.21.15.114:0/3196641884 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7fdfe8058740 con 0x7fdff00b33d0 2024-04-13T02:46:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-04-13T02:46:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.152+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdfdc06c920 msgr2=0x7fdfdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.152+0000 7fdff52b7640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdfdc06c920 0x7fdfdc06ede0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0002000 tx=0x7fdfe0001f10 comp rx=0 tx=0).stop 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 msgr2=0x7fdff00cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 0x7fdff00cafd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdff00b5640 tx=0x7fdfe800f9f0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 shutdown_connections 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff00b33d0 0x7fdff00cafd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdff00b2f50 0x7fdff00caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdfdc06c920 0x7fdfdc06ede0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 --2- 172.21.15.114:0/3196641884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd80040d0 0x7fdff0142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 >> 172.21.15.114:0/3196641884 conn(0x7fdff009aa40 msgr2=0x7fdff0146ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 shutdown_connections 2024-04-13T02:46:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.153+0000 7fdff52b7640 1 -- 172.21.15.114:0/3196641884 wait complete. 2024-04-13T02:46:10.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-04-13T02:46:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.282+0000 7f41f73e9640 1 Processor -- start 2024-04-13T02:46:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.282+0000 7f41f73e9640 1 -- start start 2024-04-13T02:46:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f73e9640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41f009b2a0 0x7f41f0163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f73e9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00b6600 con 0x7f41f015eb90 2024-04-13T02:46:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f73e9640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00b68e0 con 0x7f41f00b76a0 2024-04-13T02:46:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f73e9640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f41f009bd30 con 0x7f41f009b2a0 2024-04-13T02:46:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f5185640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f41f015eb90 0x7f41f009ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53212/0 (socket says 172.21.15.114:53212) 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f5185640 1 -- 172.21.15.114:0/995543303 learned_addr learned my addr 172.21.15.114:0/995543303 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41f4984640 1 --2- 172.21.15.114:0/995543303 >> v2:172.21.15.130:3300/0 conn(0x7f41f009b2a0 0x7f41f0163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654869069 0 0) 0x7f41f00b6600 con 0x7f41f015eb90 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.283+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41dc003520 con 0x7f41f015eb90 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928008526 0 0) 0x7f41dc003520 con 0x7f41f015eb90 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 >> v2:172.21.15.130:3300/0 conn(0x7f41f009b2a0 msgr2=0x7f41f0163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 --2- 172.21.15.114:0/995543303 >> v2:172.21.15.130:3300/0 conn(0x7f41f009b2a0 0x7f41f0163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 >> v1:172.21.15.130:6789/0 conn(0x7f41f00b76a0 legacy=0x7f41f00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00b6bc0 con 0x7f41f015eb90 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f41ec001670 con 0x7f41f015eb90 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 >> v1:172.21.15.114:6789/0 conn(0x7f41f015eb90 legacy=0x7f41f009ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41dc0039b0 0x7f41dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41dc004800 0x7f41dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc0051c0 0x7f41dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc00c030 con 0x7f41dc004800 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc00c1e0 con 0x7f41dc0039b0 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc00c3e0 con 0x7f41dc0051c0 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f4984640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41dc004800 0x7f41dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f5185640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41dc0039b0 0x7f41dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f5986640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc0051c0 0x7f41dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f4984640 1 -- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc0051c0 msgr2=0x7f41dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f4984640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc0051c0 0x7f41dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f4984640 1 -- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41dc0039b0 msgr2=0x7f41dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f4984640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41dc0039b0 0x7f41dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f4984640 1 -- 172.21.15.114:0/995543303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc003520 con 0x7f41dc004800 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.284+0000 7f41f5986640 1 -- 172.21.15.114:0/995543303 reap_dead start 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.285+0000 7f41f4984640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41dc004800 0x7f41dc004c80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009ac0 tx=0x7f41dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f44f759b48634d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.285+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0039070 con 0x7f41dc004800 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.285+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e002c6b0 con 0x7f41dc004800 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.285+0000 7f41e7fff640 1 -- 172.21.15.114:0/995543303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0009690 con 0x7f41dc004800 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.285+0000 7f41f73e9640 1 -- 172.21.15.114:0/995543303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41dc004800 msgr2=0x7f41dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.285+0000 7f41f73e9640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41dc004800 0x7f41dc004c80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009ac0 tx=0x7f41dc005830 comp rx=0 tx=0).stop 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.286+0000 7f41f73e9640 1 -- 172.21.15.114:0/995543303 shutdown_connections 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.286+0000 7f41f73e9640 1 --2- 172.21.15.114:0/995543303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41dc004800 0x7f41dc004c80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.286+0000 7f41f73e9640 1 -- 172.21.15.114:0/995543303 >> 172.21.15.114:0/995543303 conn(0x7f41f00b4400 msgr2=0x7f41f00b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.286+0000 7f41f73e9640 1 -- 172.21.15.114:0/995543303 shutdown_connections 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.286+0000 7f41f73e9640 1 -- 172.21.15.114:0/995543303 wait complete. 2024-04-13T02:46:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 Processor -- start 2024-04-13T02:46:10.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 -- start start 2024-04-13T02:46:10.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc004800 0x7f41f0144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 0x7f41f00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f00cbfc0 0x7f41f00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f41f015ef70 con 0x7f41f0143d50 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41f00b7180 con 0x7f41f00cbfc0 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.287+0000 7f41f73e9640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f41f00b6060 con 0x7f41dc004800 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 0x7f41f00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 0x7f41f00cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34212/0 (socket says 172.21.15.114:34212) 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 -- 172.21.15.114:0/4055185204 learned_addr learned my addr 172.21.15.114:0/4055185204 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f5986640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f00cbfc0 0x7f41f00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f5185640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc004800 0x7f41f0144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 -- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc004800 msgr2=0x7f41f0144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc004800 0x7f41f0144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 -- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f00cbfc0 msgr2=0x7f41f00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f00cbfc0 0x7f41f00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 -- 172.21.15.114:0/4055185204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00ceae0 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f5185640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc004800 0x7f41f0144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f4984640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 0x7f41f00cba80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f41e0000c00 tx=0x7f41e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0042020 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e003a040 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0039070 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f00d0380 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.288+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f00ce2b0 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.289+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f0068db0 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.290+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41e0045020 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.290+0000 7f41e5ffb640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f41d406c920 0x7f41d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.290+0000 7f41f5185640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f41d406c920 0x7f41d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.291+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5424+0+0 (secure 0 0 0) 0x7f41e00acdf0 con 0x7f41f0143d50 2024-04-13T02:46:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.291+0000 7f41f5185640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f41d406c920 0x7f41d406ede0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41f01623e0 tx=0x7f41ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.295+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41e004c070 con 0x7f41f0143d50 2024-04-13T02:46:10.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:10.471+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7f41f00cc3a0 con 0x7f41f0143d50 2024-04-13T02:46:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.151+0000 7f41e5ffb640 1 -- 172.21.15.114:0/4055185204 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v39) ==== 160+0+0 (secure 0 0 0) 0x7f41e007b3d0 con 0x7f41f0143d50 2024-04-13T02:46:11.152 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'data_new' removed 2024-04-13T02:46:11.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f41d406c920 msgr2=0x7f41d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f41d406c920 0x7f41d406ede0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41f01623e0 tx=0x7f41ec009040 comp rx=0 tx=0).stop 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 msgr2=0x7f41f00cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 0x7f41f00cba80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f41e0000c00 tx=0x7f41e0004730 comp rx=0 tx=0).stop 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 shutdown_connections 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f41f00cbfc0 0x7f41f00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f0143d50 0x7f41f00cba80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f41d406c920 0x7f41d406ede0 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41f01623e0 tx=0x7f41ec009040 comp rx=0 tx=0).stop 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 --2- 172.21.15.114:0/4055185204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f41dc004800 0x7f41f0144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 >> 172.21.15.114:0/4055185204 conn(0x7f41f00b4400 msgr2=0x7f41f01626b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 shutdown_connections 2024-04-13T02:46:11.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.154+0000 7f41f73e9640 1 -- 172.21.15.114:0/4055185204 wait complete. 2024-04-13T02:46:11.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_symlink_recovery 2024-04-13T02:46:11.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.271+0000 7f7344c1c640 1 Processor -- start 2024-04-13T02:46:11.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.271+0000 7f7344c1c640 1 -- start start 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f7344c1c640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f734009b230 0x7f7340072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f7344c1c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7340071650 0x7f73400cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f7344c1c640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73400af570 con 0x7f73401600b0 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f7344c1c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f73400d3640 con 0x7f7340071650 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f7344c1c640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7340160490 con 0x7f734009b230 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7340071650 0x7f73400cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7340071650 0x7f73400cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34224/0 (socket says 172.21.15.114:34224) 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 -- 172.21.15.114:0/1700933785 learned_addr learned my addr 172.21.15.114:0/1700933785 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733dd9b640 1 --2- 172.21.15.114:0/1700933785 >> v2:172.21.15.130:3300/0 conn(0x7f734009b230 0x7f7340072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 -- 172.21.15.114:0/1700933785 >> v2:172.21.15.130:3300/0 conn(0x7f734009b230 msgr2=0x7f7340072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:11.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 --2- 172.21.15.114:0/1700933785 >> v2:172.21.15.130:3300/0 conn(0x7f734009b230 0x7f7340072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 -- 172.21.15.114:0/1700933785 >> v1:172.21.15.130:6789/0 conn(0x7f73401600b0 legacy=0x7f734009ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:11.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.272+0000 7f733ed9d640 1 -- 172.21.15.114:0/1700933785 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734009bbc0 con 0x7f7340071650 2024-04-13T02:46:11.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.273+0000 7f733ed9d640 1 --2- 172.21.15.114:0/1700933785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400cdeb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f734006c900 tx=0x7f733002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6573256e3f71cc1a server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.273+0000 7f733d59a640 1 -- 172.21.15.114:0/1700933785 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733002c9f0 con 0x7f7340071650 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.273+0000 7f733d59a640 1 -- 172.21.15.114:0/1700933785 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733002cb90 con 0x7f7340071650 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.273+0000 7f733d59a640 1 -- 172.21.15.114:0/1700933785 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73300343f0 con 0x7f7340071650 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.273+0000 7f7344c1c640 1 -- 172.21.15.114:0/1700933785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 msgr2=0x7f73400cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.273+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1700933785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400cdeb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f734006c900 tx=0x7f733002be50 comp rx=0 tx=0).stop 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.274+0000 7f7344c1c640 1 -- 172.21.15.114:0/1700933785 shutdown_connections 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.274+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1700933785 >> v2:172.21.15.130:3300/0 conn(0x7f734009b230 0x7f7340072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.274+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1700933785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400cdeb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.274+0000 7f7344c1c640 1 -- 172.21.15.114:0/1700933785 >> 172.21.15.114:0/1700933785 conn(0x7f73400d2720 msgr2=0x7f73400d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.274+0000 7f7344c1c640 1 -- 172.21.15.114:0/1700933785 shutdown_connections 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.274+0000 7f7344c1c640 1 -- 172.21.15.114:0/1700933785 wait complete. 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.275+0000 7f7344c1c640 1 Processor -- start 2024-04-13T02:46:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.275+0000 7f7344c1c640 1 -- start start 2024-04-13T02:46:11.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.275+0000 7f7344c1c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734009b230 0x7f73400caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73401600b0 0x7f73400b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73400d1460 con 0x7f7340071650 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f73400d1180 con 0x7f73401600b0 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f73400d15e0 con 0x7f734009b230 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34238/0 (socket says 172.21.15.114:34238) 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 -- 172.21.15.114:0/1988793059 learned_addr learned my addr 172.21.15.114:0/1988793059 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733dd9b640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734009b230 0x7f73400caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733ed9d640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73401600b0 0x7f73400b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 -- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734009b230 msgr2=0x7f73400caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734009b230 0x7f73400caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 -- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73401600b0 msgr2=0x7f73400b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73401600b0 0x7f73400b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 -- 172.21.15.114:0/1988793059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73400c77d0 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f733e59c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400c8850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f733800b3f0 tx=0x7f733800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338015020 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7338011830 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73400c7ab0 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338011c20 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.276+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73400c8070 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.277+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7340068c80 con 0x7f7340071650 2024-04-13T02:46:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.278+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7338018020 con 0x7f7340071650 2024-04-13T02:46:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.278+0000 7f7336ffd640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732006c8f0 0x7f732006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.278+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f733808b4c0 con 0x7f7340071650 2024-04-13T02:46:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.278+0000 7f733dd9b640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732006c8f0 0x7f732006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.279+0000 7f733dd9b640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732006c8f0 0x7f732006edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f73400cc7f0 tx=0x7f7328008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.283+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f733801f030 con 0x7f7340071650 2024-04-13T02:46:11.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.456+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"} v 0) -- 0x7f73400c6000 con 0x7f7340071650 2024-04-13T02:46:11.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.459+0000 7f7336ffd640 1 -- 172.21.15.114:0/1988793059 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"}]=0 v13) ==== 103+0+0 (secure 0 0 0) 0x7f73380172c0 con 0x7f7340071650 2024-04-13T02:46:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732006c8f0 msgr2=0x7f732006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732006c8f0 0x7f732006edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f73400cc7f0 tx=0x7f7328008040 comp rx=0 tx=0).stop 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 msgr2=0x7f73400c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400c8850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f733800b3f0 tx=0x7f733800b8b0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 shutdown_connections 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73401600b0 0x7f73400b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732006c8f0 0x7f732006edb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734009b230 0x7f73400caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 --2- 172.21.15.114:0/1988793059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7340071650 0x7f73400c8850 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.461+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 >> 172.21.15.114:0/1988793059 conn(0x7f73400d2720 msgr2=0x7f734015d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.462+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 shutdown_connections 2024-04-13T02:46:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.462+0000 7f7344c1c640 1 -- 172.21.15.114:0/1988793059 wait complete. 2024-04-13T02:46:11.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-13T02:46:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.578+0000 7f1798708640 1 Processor -- start 2024-04-13T02:46:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.579+0000 7f1798708640 1 -- start start 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1798708640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f179015ecc0 0x7f17900d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1798708640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17900d3270 0x7f17900b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1798708640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f17900b3720 0x7f17900b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1798708640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f179015f0a0 con 0x7f17900d3270 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1798708640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f17900ba280 con 0x7f17900b3720 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1798708640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f17900ba4d0 con 0x7f179015ecc0 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17900d3270 0x7f17900b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17900d3270 0x7f17900b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34240/0 (socket says 172.21.15.114:34240) 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 -- 172.21.15.114:0/570187075 learned_addr learned my addr 172.21.15.114:0/570187075 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f17964a4640 1 --2- 172.21.15.114:0/570187075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f179015ecc0 0x7f17900d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1796ca5640 1 --2- 172.21.15.114:0/570187075 >> v2:172.21.15.130:3300/0 conn(0x7f17900b3720 0x7f17900b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 -- 172.21.15.114:0/570187075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f179015ecc0 msgr2=0x7f17900d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 --2- 172.21.15.114:0/570187075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f179015ecc0 0x7f17900d2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 -- 172.21.15.114:0/570187075 >> v2:172.21.15.130:3300/0 conn(0x7f17900b3720 msgr2=0x7f17900b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 --2- 172.21.15.114:0/570187075 >> v2:172.21.15.130:3300/0 conn(0x7f17900b3720 0x7f17900b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.580+0000 7f1795ca3640 1 -- 172.21.15.114:0/570187075 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17900ba7b0 con 0x7f17900d3270 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.581+0000 7f1795ca3640 1 --2- 172.21.15.114:0/570187075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900d3270 0x7f17900b95f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f179006ce40 tx=0x7f178002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a2ddb1c486e3b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.581+0000 7f17954a2640 1 -- 172.21.15.114:0/570187075 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780035020 con 0x7f17900d3270 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.581+0000 7f17954a2640 1 -- 172.21.15.114:0/570187075 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780031870 con 0x7f17900d3270 2024-04-13T02:46:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.581+0000 7f17954a2640 1 -- 172.21.15.114:0/570187075 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780031c40 con 0x7f17900d3270 2024-04-13T02:46:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 -- 172.21.15.114:0/570187075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900d3270 msgr2=0x7f17900b95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 --2- 172.21.15.114:0/570187075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900d3270 0x7f17900b95f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f179006ce40 tx=0x7f178002b910 comp rx=0 tx=0).stop 2024-04-13T02:46:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 -- 172.21.15.114:0/570187075 shutdown_connections 2024-04-13T02:46:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 --2- 172.21.15.114:0/570187075 >> v2:172.21.15.130:3300/0 conn(0x7f17900b3720 0x7f17900b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 --2- 172.21.15.114:0/570187075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900d3270 0x7f17900b95f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 --2- 172.21.15.114:0/570187075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f179015ecc0 0x7f17900d2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 -- 172.21.15.114:0/570187075 >> 172.21.15.114:0/570187075 conn(0x7f1790073480 msgr2=0x7f1790073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 -- 172.21.15.114:0/570187075 shutdown_connections 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.582+0000 7f1798708640 1 -- 172.21.15.114:0/570187075 wait complete. 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.583+0000 7f1798708640 1 Processor -- start 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.583+0000 7f1798708640 1 -- start start 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1798708640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 0x7f17900cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1798708640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17900d3270 0x7f17901f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1798708640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179015ecc0 0x7f17900cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1798708640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17900b3c70 con 0x7f17900b3720 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1798708640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f17900b90d0 con 0x7f179015ecc0 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1798708640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f17900b3df0 con 0x7f17900d3270 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 0x7f17900cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 0x7f17900cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34248/0 (socket says 172.21.15.114:34248) 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 -- 172.21.15.114:0/2485870442 learned_addr learned my addr 172.21.15.114:0/2485870442 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1795ca3640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17900d3270 0x7f17901f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f1796ca5640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179015ecc0 0x7f17900cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 -- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17900d3270 msgr2=0x7f17901f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17900d3270 0x7f17901f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 -- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179015ecc0 msgr2=0x7f17900cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179015ecc0 0x7f17900cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.584+0000 7f17964a4640 1 -- 172.21.15.114:0/2485870442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17900ccc70 con 0x7f17900b3720 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.585+0000 7f17964a4640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 0x7f17900cdee0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f178c00e9b0 tx=0x7f178c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.585+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c017070 con 0x7f17900b3720 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.585+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c00c9a0 con 0x7f17900b3720 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.585+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179015f330 con 0x7f17900b3720 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.585+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c00cd90 con 0x7f17900b3720 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.585+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179015f8f0 con 0x7f17900b3720 2024-04-13T02:46:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.586+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1790068c80 con 0x7f17900b3720 2024-04-13T02:46:11.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.586+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f178c01a070 con 0x7f17900b3720 2024-04-13T02:46:11.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.586+0000 7f1786ffd640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f177406c8f0 0x7f177406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.587+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f178c08b810 con 0x7f17900b3720 2024-04-13T02:46:11.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.587+0000 7f1795ca3640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f177406c8f0 0x7f177406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.587+0000 7f1795ca3640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f177406c8f0 0x7f177406edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1780036000 tx=0x7f178003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.591+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f178c059890 con 0x7f17900b3720 2024-04-13T02:46:11.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.764+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f17901f4930 con 0x7f17900b3720 2024-04-13T02:46:11.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.767+0000 7f1786ffd640 1 -- 172.21.15.114:0/2485870442 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7f178c05db90 con 0x7f17900b3720 2024-04-13T02:46:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f177406c8f0 msgr2=0x7f177406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f177406c8f0 0x7f177406edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1780036000 tx=0x7f178003c040 comp rx=0 tx=0).stop 2024-04-13T02:46:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 msgr2=0x7f17900cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 0x7f17900cdee0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f178c00e9b0 tx=0x7f178c00ee70 comp rx=0 tx=0).stop 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 shutdown_connections 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179015ecc0 0x7f17900cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f177406c8f0 0x7f177406edb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17900d3270 0x7f17901f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 --2- 172.21.15.114:0/2485870442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17900b3720 0x7f17900cdee0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 >> 172.21.15.114:0/2485870442 conn(0x7f1790073480 msgr2=0x7f179015df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 shutdown_connections 2024-04-13T02:46:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.769+0000 7f1798708640 1 -- 172.21.15.114:0/2485870442 wait complete. 2024-04-13T02:46:11.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-04-13T02:46:11.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.880+0000 7fd80f515640 1 Processor -- start 2024-04-13T02:46:11.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.881+0000 7fd80f515640 1 -- start start 2024-04-13T02:46:11.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.881+0000 7fd80f515640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8081552e0 0x7fd8080afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.881+0000 7fd80f515640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd80815c170 0x7fd808072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.881+0000 7fd80f515640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8080b48e0 con 0x7fd8081556c0 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.881+0000 7fd80f515640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd8080b38d0 con 0x7fd8081552e0 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.881+0000 7fd80f515640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd8080b3b20 con 0x7fd80815c170 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8081552e0 0x7fd8080afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80cab0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd80815c170 0x7fd808072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8081552e0 0x7fd8080afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:40898/0 (socket says 172.21.15.114:40898) 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 -- 172.21.15.114:0/1959016664 learned_addr learned my addr 172.21.15.114:0/1959016664 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:11.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80dab2640 1 --1- 172.21.15.114:0/1959016664 >> v1:172.21.15.130:6789/0 conn(0x7fd8081556c0 0x7fd80815ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:33508/0 (socket says 172.21.15.114:33508) 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 -- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd80815c170 msgr2=0x7fd808072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 --2- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd80815c170 0x7fd808072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 -- 172.21.15.114:0/1959016664 >> v1:172.21.15.130:6789/0 conn(0x7fd8081556c0 legacy=0x7fd80815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80d2b1640 1 -- 172.21.15.114:0/1959016664 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8080b3e00 con 0x7fd8081552e0 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd7fffff640 1 -- 172.21.15.114:0/1959016664 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928053483 0 0) 0x7fd8080b48e0 con 0x7fd8081556c0 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.882+0000 7fd80cab0640 1 --2- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd80815c170 0x7fd808072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.883+0000 7fd80d2b1640 1 --2- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8081552e0 0x7fd8080afb60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd804009e50 tx=0x7fd80402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba4ad30e23a439f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.883+0000 7fd7fffff640 1 -- 172.21.15.114:0/1959016664 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80402cb00 con 0x7fd8081552e0 2024-04-13T02:46:11.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.883+0000 7fd7fffff640 1 -- 172.21.15.114:0/1959016664 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80402cca0 con 0x7fd8081552e0 2024-04-13T02:46:11.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.883+0000 7fd7fffff640 1 -- 172.21.15.114:0/1959016664 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804034610 con 0x7fd8081552e0 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 -- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8081552e0 msgr2=0x7fd8080afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 --2- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8081552e0 0x7fd8080afb60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd804009e50 tx=0x7fd80402bf60 comp rx=0 tx=0).stop 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 -- 172.21.15.114:0/1959016664 shutdown_connections 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 --2- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd80815c170 0x7fd808072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 --2- 172.21.15.114:0/1959016664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8081552e0 0x7fd8080afb60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 -- 172.21.15.114:0/1959016664 >> 172.21.15.114:0/1959016664 conn(0x7fd8080b27b0 msgr2=0x7fd8080b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 -- 172.21.15.114:0/1959016664 shutdown_connections 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.884+0000 7fd80f515640 1 -- 172.21.15.114:0/1959016664 wait complete. 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.885+0000 7fd80f515640 1 Processor -- start 2024-04-13T02:46:11.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.885+0000 7fd80f515640 1 -- start start 2024-04-13T02:46:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80f515640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8081552e0 0x7fd8080afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80f515640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 0x7fd80814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80f515640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd80815c170 0x7fd8080b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80f515640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd8080d0010 con 0x7fd8081556c0 2024-04-13T02:46:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80f515640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8080b43c0 con 0x7fd80815c170 2024-04-13T02:46:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80f515640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd8080d0190 con 0x7fd8081552e0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 0x7fd80814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 0x7fd80814e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34260/0 (socket says 172.21.15.114:34260) 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 -- 172.21.15.114:0/2835415401 learned_addr learned my addr 172.21.15.114:0/2835415401 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80dab2640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd80815c170 0x7fd8080b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80d2b1640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8081552e0 0x7fd8080afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 -- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8081552e0 msgr2=0x7fd8080afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8081552e0 0x7fd8080afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 -- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd80815c170 msgr2=0x7fd8080b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd80815c170 0x7fd8080b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 -- 172.21.15.114:0/2835415401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8080a9880 con 0x7fd8081556c0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.886+0000 7fd80cab0640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 0x7fd80814e650 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e960 tx=0x7fd7f800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.887+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8017070 con 0x7fd8081556c0 2024-04-13T02:46:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.887+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f800ca00 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.887+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800cdd0 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.887+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8080a9fe0 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.887+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80814f0e0 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.888+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd808068c80 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.888+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7f801a070 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.889+0000 7fd7fdffb640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd7ec06c8f0 0x7fd7ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.889+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fd7f808b9e0 con 0x7fd8081556c0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.889+0000 7fd80d2b1640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd7ec06c8f0 0x7fd7ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.889+0000 7fd80d2b1640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd7ec06c8f0 0x7fd7ec06edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd804035000 tx=0x7fd804030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:11.893+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7f8059af0 con 0x7fd8081556c0 2024-04-13T02:46:12.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2024-04-13T02:46:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.135+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7fd8080b56d0 con 0x7fd8081556c0 2024-04-13T02:46:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.158+0000 7fd7fdffb640 1 -- 172.21.15.114:0/2835415401 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v105) ==== 135+0+0 (secure 0 0 0) 0x7fd7f805ddf0 con 0x7fd8081556c0 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.160+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd7ec06c8f0 msgr2=0x7fd7ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.160+0000 7fd80f515640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd7ec06c8f0 0x7fd7ec06edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd804035000 tx=0x7fd804030000 comp rx=0 tx=0).stop 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.160+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 msgr2=0x7fd80814e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.160+0000 7fd80f515640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 0x7fd80814e650 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e960 tx=0x7fd7f800ee20 comp rx=0 tx=0).stop 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 shutdown_connections 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd80815c170 0x7fd8080b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8081556c0 0x7fd80814e650 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fd7ec06c8f0 0x7fd7ec06edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 --2- 172.21.15.114:0/2835415401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd8081552e0 0x7fd8080afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 >> 172.21.15.114:0/2835415401 conn(0x7fd8080b27b0 msgr2=0x7fd80815c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 shutdown_connections 2024-04-13T02:46:12.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:12.161+0000 7fd80f515640 1 -- 172.21.15.114:0/2835415401 wait complete. 2024-04-13T02:46:12.174 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files ... ERROR 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/test_backtrace.py", line 73, in test_backtrace 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: self.fs.mds_asok(["flush", "journal"]) 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 1341, in mds_asok 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: return self.rank_asok(*args, **kwargs) 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 1364, in rank_asok 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: return self.mds_asok(*args, mds_id=info['name'], **kwargs) 2024-04-13T02:46:12.175 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 1346, in mds_asok 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: return self.json_asok(list(args), 'mds', mds_id, **kwargs) 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 266, in json_asok 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: proc = self.mon_manager.admin_socket(service_type, service_id, command, timeout=timeout) 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1922, in admin_socket 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: return remote.run( 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal' 2024-04-13T02:46:12.176 INFO:tasks.cephfs_test_runner: 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:Ran 1 test in 66.568s 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner: 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner: 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/test_backtrace.py", line 73, in test_backtrace 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner: self.fs.mds_asok(["flush", "journal"]) 2024-04-13T02:46:12.177 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 1341, in mds_asok 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: return self.rank_asok(*args, **kwargs) 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 1364, in rank_asok 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: return self.mds_asok(*args, mds_id=info['name'], **kwargs) 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 1346, in mds_asok 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: return self.json_asok(list(args), 'mds', mds_id, **kwargs) 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/filesystem.py", line 266, in json_asok 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: proc = self.mon_manager.admin_socket(service_type, service_id, command, timeout=timeout) 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1922, in admin_socket 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: return remote.run( 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-13T02:46:12.178 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-13T02:46:12.179 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal' 2024-04-13T02:46:12.179 INFO:tasks.cephfs_test_runner: 2024-04-13T02:46:12.179 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-04-13T02:46:12.453 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c9282ce33cfe4d2abe15fed063f5aef7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-04-13T02:46:12.454 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-13T02:46:12.464 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-13T02:46:12.490 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-13T02:46:12.490 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:46:12.490 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:12.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=463 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-13T02:46:12.509 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-13T02:46:12.509 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:12.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=463 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-13T02:46:12.565 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:46:12.566 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:12.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17585 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-13T02:46:12.585 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-13T02:46:12.585 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-13T02:46:12.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17585 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-13T02:46:12.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.643 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:46:12.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-13T02:46:12.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-13T02:46:12.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-13T02:46:12.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-13T02:46:12.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-13T02:46:12.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.896 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-13T02:46:12.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-13T02:46:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-13T02:46:12.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:12.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:12.982 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-13T02:46:13.000 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-13T02:46:13.000 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-13T02:46:13.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:13.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-13T02:46:13.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:13.072 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-13T02:46:13.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:13.142 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-13T02:46:13.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:13.250 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-13T02:46:13.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-13T02:46:13.266 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-13T02:46:13.336 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-04-13T02:46:13.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:13.338 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-13T02:46:13.347 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-13T02:46:13.347 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:46:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.448+0000 7f891df1e640 1 Processor -- start 2024-04-13T02:46:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.448+0000 7f891df1e640 1 -- start start 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.448+0000 7f891df1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f891815b6d0 0x7f89180cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f891df1e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8918070210 0x7f89180b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f891df1e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89180ce250 0x7f89180b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f891df1e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f891806f940 con 0x7f89180ce250 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f891df1e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f891806e8a0 con 0x7f8918070210 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f891df1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f891806eb80 con 0x7f891815b6d0 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89180ce250 0x7f89180b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89180ce250 0x7f89180b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34266/0 (socket says 172.21.15.114:34266) 2024-04-13T02:46:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 -- 172.21.15.114:0/1214565072 learned_addr learned my addr 172.21.15.114:0/1214565072 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8916ffd640 1 --2- 172.21.15.114:0/1214565072 >> v2:172.21.15.130:3300/0 conn(0x7f8918070210 0x7f89180b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f89177fe640 1 --2- 172.21.15.114:0/1214565072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f891815b6d0 0x7f89180cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 -- 172.21.15.114:0/1214565072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f891815b6d0 msgr2=0x7f89180cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 --2- 172.21.15.114:0/1214565072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f891815b6d0 0x7f89180cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 -- 172.21.15.114:0/1214565072 >> v2:172.21.15.130:3300/0 conn(0x7f8918070210 msgr2=0x7f89180b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 --2- 172.21.15.114:0/1214565072 >> v2:172.21.15.130:3300/0 conn(0x7f8918070210 0x7f89180b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8917fff640 1 -- 172.21.15.114:0/1214565072 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891806ee60 con 0x7f89180ce250 2024-04-13T02:46:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.449+0000 7f8916ffd640 1 --2- 172.21.15.114:0/1214565072 >> v2:172.21.15.130:3300/0 conn(0x7f8918070210 0x7f89180b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.450+0000 7f8917fff640 1 --2- 172.21.15.114:0/1214565072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89180ce250 0x7f89180b5020 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8918071d50 tx=0x7f891002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7005cce7d989ae37 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.450+0000 7f89167fc640 1 -- 172.21.15.114:0/1214565072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891002c9e0 con 0x7f89180ce250 2024-04-13T02:46:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.450+0000 7f89167fc640 1 -- 172.21.15.114:0/1214565072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891002cb80 con 0x7f89180ce250 2024-04-13T02:46:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.450+0000 7f89167fc640 1 -- 172.21.15.114:0/1214565072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100343f0 con 0x7f89180ce250 2024-04-13T02:46:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 -- 172.21.15.114:0/1214565072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89180ce250 msgr2=0x7f89180b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 --2- 172.21.15.114:0/1214565072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89180ce250 0x7f89180b5020 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8918071d50 tx=0x7f891002be40 comp rx=0 tx=0).stop 2024-04-13T02:46:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 -- 172.21.15.114:0/1214565072 shutdown_connections 2024-04-13T02:46:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 --2- 172.21.15.114:0/1214565072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89180ce250 0x7f89180b5020 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 --2- 172.21.15.114:0/1214565072 >> v2:172.21.15.130:3300/0 conn(0x7f8918070210 0x7f89180b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 --2- 172.21.15.114:0/1214565072 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f891815b6d0 0x7f89180cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 -- 172.21.15.114:0/1214565072 >> 172.21.15.114:0/1214565072 conn(0x7f89180b27b0 msgr2=0x7f89180b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 -- 172.21.15.114:0/1214565072 shutdown_connections 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.451+0000 7f891df1e640 1 -- 172.21.15.114:0/1214565072 wait complete. 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.452+0000 7f891df1e640 1 Processor -- start 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.452+0000 7f891df1e640 1 -- start start 2024-04-13T02:46:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918070210 0x7f89181430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180ce250 0x7f89181511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 0x7f891814afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f89180721e0 con 0x7f891815b6d0 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f891806f420 con 0x7f8918070210 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8918072360 con 0x7f89180ce250 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 0x7f891814afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f89177fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918070210 0x7f89181430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 0x7f891814afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34282/0 (socket says 172.21.15.114:34282) 2024-04-13T02:46:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 -- 172.21.15.114:0/2194216764 learned_addr learned my addr 172.21.15.114:0/2194216764 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8916ffd640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180ce250 0x7f89181511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 -- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180ce250 msgr2=0x7f89181511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180ce250 0x7f89181511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 -- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918070210 msgr2=0x7f89181430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918070210 0x7f89181430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 -- 172.21.15.114:0/2194216764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8918150130 con 0x7f891815b6d0 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f89177fe640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918070210 0x7f89181430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f8917fff640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 0x7f891814afc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8910009f40 tx=0x7f8910004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910043020 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891003e450 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8918150410 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910009510 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.453+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89181509d0 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.454+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8918068c80 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.455+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8910046020 con 0x7f891815b6d0 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.455+0000 7f88fffff640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f890406c8f0 0x7f890406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.455+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f89100adfc0 con 0x7f891815b6d0 2024-04-13T02:46:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.455+0000 7f89177fe640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f890406c8f0 0x7f890406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.456+0000 7f89177fe640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f890406c8f0 0x7f890406edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f890800ae10 tx=0x7f8908008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.460+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f891004d030 con 0x7f891815b6d0 2024-04-13T02:46:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.631+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89180ce900 con 0x7f890406c8f0 2024-04-13T02:46:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.632+0000 7f88fffff640 1 -- 172.21.15.114:0/2194216764 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13489 (secure 0 0 0) 0x7f89180ce900 con 0x7f890406c8f0 2024-04-13T02:46:13.634 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:46:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f890406c8f0 msgr2=0x7f890406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f890406c8f0 0x7f890406edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f890800ae10 tx=0x7f8908008040 comp rx=0 tx=0).stop 2024-04-13T02:46:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 msgr2=0x7f891814afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 0x7f891814afc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8910009f40 tx=0x7f8910004a40 comp rx=0 tx=0).stop 2024-04-13T02:46:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 shutdown_connections 2024-04-13T02:46:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f891815b6d0 0x7f891814afc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f890406c8f0 0x7f890406edb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89180ce250 0x7f89181511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 --2- 172.21.15.114:0/2194216764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8918070210 0x7f89181430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 >> 172.21.15.114:0/2194216764 conn(0x7f89180b27b0 msgr2=0x7f8918155590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 shutdown_connections 2024-04-13T02:46:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.634+0000 7f891df1e640 1 -- 172.21.15.114:0/2194216764 wait complete. 2024-04-13T02:46:13.645 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-13T02:46:13.506792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220924,"kb_used_data":4728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753796,"statfs":{"total":773094113280,"available":772867887104,"internally_reserved":0,"allocated":4841472,"data_stored":2660856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40392,"num_objects":-31,"num_object_clones":0,"num_object_copies":-62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31,"num_whiteouts":0,"num_read":-31,"num_read_kb":-34,"num_write":-145,"num_write_kb":-101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000966"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T02:46:11.155838+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:46:11.155838+0000","last_peered":"2024-04-13T02:46:11.155838+0000","last_clean":"2024-04-13T02:46:11.155838+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:46:11.155838+0000","last_undegraded":"2024-04-13T02:46:11.155838+0000","last_fullsized":"2024-04-13T02:46:11.155838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":180087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:46:13.646 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:46:13.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.746+0000 7f544dcde640 1 Processor -- start 2024-04-13T02:46:13.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.746+0000 7f544dcde640 1 -- start start 2024-04-13T02:46:13.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f544dcde640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544809ab90 0x7f544809aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f544dcde640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54480b3030 0x7f54480b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f544dcde640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54480cce20 con 0x7f544815caf0 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f544dcde640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f544809b530 con 0x7f54480b3030 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f544dcde640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f54480d1dc0 con 0x7f544809ab90 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5447fff640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54480b3030 0x7f54480b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5446ffd640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544809ab90 0x7f544809aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f54477fe640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f544815caf0 0x7f54480d1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:33524/0 (socket says 172.21.15.114:33524) 2024-04-13T02:46:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f54477fe640 1 -- 172.21.15.114:0/1961593717 learned_addr learned my addr 172.21.15.114:0/1961593717 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5447fff640 1 --2- 172.21.15.114:0/1961593717 >> v2:172.21.15.130:3300/0 conn(0x7f54480b3030 0x7f54480b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:40952/0 (socket says 172.21.15.114:40952) 2024-04-13T02:46:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5446ffd640 1 --2- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544809ab90 0x7f544809aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:49232/0 (socket says 172.21.15.114:49232) 2024-04-13T02:46:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5447fff640 1 -- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544809ab90 msgr2=0x7f544809aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5447fff640 1 --2- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544809ab90 0x7f544809aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5447fff640 1 -- 172.21.15.114:0/1961593717 >> v1:172.21.15.130:6789/0 conn(0x7f544815caf0 legacy=0x7f54480d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f5447fff640 1 -- 172.21.15.114:0/1961593717 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54480b2270 con 0x7f54480b3030 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.747+0000 7f54467fc640 1 -- 172.21.15.114:0/1961593717 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836272297 0 0) 0x7f54480cce20 con 0x7f544815caf0 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.748+0000 7f5447fff640 1 --2- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f54480b34c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5440009d90 tx=0x7f544002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc635111e766c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.748+0000 7f54467fc640 1 -- 172.21.15.114:0/1961593717 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440039070 con 0x7f54480b3030 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.748+0000 7f54467fc640 1 -- 172.21.15.114:0/1961593717 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544002cc50 con 0x7f54480b3030 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.748+0000 7f54467fc640 1 -- 172.21.15.114:0/1961593717 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440034440 con 0x7f54480b3030 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 -- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 msgr2=0x7f54480b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 --2- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f54480b34c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5440009d90 tx=0x7f544002bea0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 -- 172.21.15.114:0/1961593717 shutdown_connections 2024-04-13T02:46:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 --2- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f54480b34c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 --2- 172.21.15.114:0/1961593717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544809ab90 0x7f544809aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 -- 172.21.15.114:0/1961593717 >> 172.21.15.114:0/1961593717 conn(0x7f54480d27d0 msgr2=0x7f54480d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 -- 172.21.15.114:0/1961593717 shutdown_connections 2024-04-13T02:46:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.749+0000 7f544dcde640 1 -- 172.21.15.114:0/1961593717 wait complete. 2024-04-13T02:46:13.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.750+0000 7f544dcde640 1 Processor -- start 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.750+0000 7f544dcde640 1 -- start start 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 0x7f544815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f544815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544815caf0 0x7f5448156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f54480b2b10 con 0x7f544809ab90 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54480b2830 con 0x7f54480b3030 2024-04-13T02:46:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f54480d1a80 con 0x7f544815caf0 2024-04-13T02:46:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 0x7f544815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 0x7f544815f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34294/0 (socket says 172.21.15.114:34294) 2024-04-13T02:46:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 -- 172.21.15.114:0/558991227 learned_addr learned my addr 172.21.15.114:0/558991227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f5446ffd640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f544815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f5447fff640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544815caf0 0x7f5448156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 -- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544815caf0 msgr2=0x7f5448156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544815caf0 0x7f5448156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 -- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 msgr2=0x7f544815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f544815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 -- 172.21.15.114:0/558991227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5448157810 con 0x7f544809ab90 2024-04-13T02:46:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f5446ffd640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f544815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f5447fff640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544815caf0 0x7f5448156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f54477fe640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 0x7f544815f8d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f543800c430 tx=0x7f543800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380074e0 con 0x7f544809ab90 2024-04-13T02:46:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54380047e0 con 0x7f544809ab90 2024-04-13T02:46:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54481f51d0 con 0x7f544809ab90 2024-04-13T02:46:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438004bd0 con 0x7f544809ab90 2024-04-13T02:46:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.751+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5448159060 con 0x7f544809ab90 2024-04-13T02:46:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.752+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5448068c80 con 0x7f544809ab90 2024-04-13T02:46:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.753+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5438011070 con 0x7f544809ab90 2024-04-13T02:46:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.753+0000 7f542ffff640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f543406c8f0 0x7f543406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.753+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f543808b5b0 con 0x7f544809ab90 2024-04-13T02:46:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.753+0000 7f5446ffd640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f543406c8f0 0x7f543406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:13.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.754+0000 7f5446ffd640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f543406c8f0 0x7f543406edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f543c009b90 tx=0x7f543c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:13.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.757+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5438059c00 con 0x7f544809ab90 2024-04-13T02:46:13.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.929+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5448072270 con 0x7f543406c8f0 2024-04-13T02:46:13.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.929+0000 7f542ffff640 1 -- 172.21.15.114:0/558991227 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13489 (secure 0 0 0) 0x7f5448072270 con 0x7f543406c8f0 2024-04-13T02:46:13.930 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:46:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f543406c8f0 msgr2=0x7f543406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f543406c8f0 0x7f543406edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f543c009b90 tx=0x7f543c008040 comp rx=0 tx=0).stop 2024-04-13T02:46:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 msgr2=0x7f544815f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 0x7f544815f8d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f543800c430 tx=0x7f543800c8f0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 shutdown_connections 2024-04-13T02:46:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f543406c8f0 0x7f543406edb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f544815caf0 0x7f5448156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54480b3030 0x7f544815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.931+0000 7f544dcde640 1 --2- 172.21.15.114:0/558991227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544809ab90 0x7f544815f8d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.932+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 >> 172.21.15.114:0/558991227 conn(0x7f54480d27d0 msgr2=0x7f54480b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.932+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 shutdown_connections 2024-04-13T02:46:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:13.932+0000 7f544dcde640 1 -- 172.21.15.114:0/558991227 wait complete. 2024-04-13T02:46:13.943 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-13T02:46:13.506792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220924,"kb_used_data":4728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753796,"statfs":{"total":773094113280,"available":772867887104,"internally_reserved":0,"allocated":4841472,"data_stored":2660856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40392,"num_objects":-31,"num_object_clones":0,"num_object_copies":-62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31,"num_whiteouts":0,"num_read":-31,"num_read_kb":-34,"num_write":-145,"num_write_kb":-101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000966"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T02:46:11.155838+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:46:11.155838+0000","last_peered":"2024-04-13T02:46:11.155838+0000","last_clean":"2024-04-13T02:46:11.155838+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:46:11.155838+0000","last_undegraded":"2024-04-13T02:46:11.155838+0000","last_fullsized":"2024-04-13T02:46:11.155838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":180087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:46:13.943 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-13T02:46:13.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:46:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.043+0000 7f49d8d88640 1 Processor -- start 2024-04-13T02:46:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.043+0000 7f49d8d88640 1 -- start start 2024-04-13T02:46:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d8d88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d40b5a10 0x7f49d409ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d8d88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d409b140 0x7f49d40afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d8d88640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d40b5f40 con 0x7f49d415ca20 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d8d88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f49d415ce00 con 0x7f49d409b140 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d8d88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f49d40b6220 con 0x7f49d40b5a10 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d409b140 0x7f49d40afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.044+0000 7f49d2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d409b140 0x7f49d40afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34306/0 (socket says 172.21.15.114:34306) 2024-04-13T02:46:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1222333336 learned_addr learned my addr 172.21.15.114:0/1222333336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1222333336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d40b5a10 msgr2=0x7f49d409ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d1d9b640 1 --2- 172.21.15.114:0/1222333336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d40b5a10 0x7f49d409ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d2d9d640 1 --2- 172.21.15.114:0/1222333336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d40b5a10 0x7f49d409ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1222333336 >> v1:172.21.15.130:6789/0 conn(0x7f49d415ca20 legacy=0x7f49d415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1222333336 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d40b6500 con 0x7f49d409b140 2024-04-13T02:46:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.045+0000 7f49d2d9d640 1 --2- 172.21.15.114:0/1222333336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d409b140 0x7f49d40afe40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009870 tx=0x7f49cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1a54df970eae80 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d159a640 1 -- 172.21.15.114:0/1222333336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc035020 con 0x7f49d409b140 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d159a640 1 -- 172.21.15.114:0/1222333336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc031640 con 0x7f49d409b140 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d159a640 1 -- 172.21.15.114:0/1222333336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc02d040 con 0x7f49d409b140 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 -- 172.21.15.114:0/1222333336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d409b140 msgr2=0x7f49d40afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1222333336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d409b140 0x7f49d40afe40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009870 tx=0x7f49cc02b8f0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 -- 172.21.15.114:0/1222333336 shutdown_connections 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1222333336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d40b5a10 0x7f49d409ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1222333336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d409b140 0x7f49d40afe40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 -- 172.21.15.114:0/1222333336 >> 172.21.15.114:0/1222333336 conn(0x7f49d40b4400 msgr2=0x7f49d40b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 -- 172.21.15.114:0/1222333336 shutdown_connections 2024-04-13T02:46:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.046+0000 7f49d8d88640 1 -- 172.21.15.114:0/1222333336 wait complete. 2024-04-13T02:46:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 Processor -- start 2024-04-13T02:46:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 -- start start 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d409b140 0x7f49d41545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49d40b5a10 0x7f49d41583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 0x7f49d4158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49d40b0380 con 0x7f49d415ca20 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f49d40b6ac0 con 0x7f49d40b5a10 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.048+0000 7f49d8d88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f49d40b0500 con 0x7f49d409b140 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 0x7f49d4158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 0x7f49d4158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34320/0 (socket says 172.21.15.114:34320) 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1335641602 learned_addr learned my addr 172.21.15.114:0/1335641602 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d259c640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d409b140 0x7f49d41545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d1d9b640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49d40b5a10 0x7f49d41583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d409b140 msgr2=0x7f49d41545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d409b140 0x7f49d41545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49d40b5a10 msgr2=0x7f49d41583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49d40b5a10 0x7f49d41583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 -- 172.21.15.114:0/1335641602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d4154b00 con 0x7f49d415ca20 2024-04-13T02:46:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d2d9d640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 0x7f49d4158930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009870 tx=0x7f49cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc040070 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc039c10 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc035040 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d415f180 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.049+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d415f740 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.050+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d4068c80 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.051+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49cc04b060 con 0x7f49d415ca20 2024-04-13T02:46:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.051+0000 7f49c2ffd640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f49b406c8f0 0x7f49b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.051+0000 7f49d259c640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f49b406c8f0 0x7f49b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.051+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f49cc0ad2b0 con 0x7f49d415ca20 2024-04-13T02:46:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.052+0000 7f49d259c640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f49b406c8f0 0x7f49b406edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009f20 tx=0x7f49c40094d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.056+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49cc07ba10 con 0x7f49d415ca20 2024-04-13T02:46:14.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.226+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49d4160640 con 0x7f49b406c8f0 2024-04-13T02:46:14.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.227+0000 7f49c2ffd640 1 -- 172.21.15.114:0/1335641602 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13489 (secure 0 0 0) 0x7f49d4160640 con 0x7f49b406c8f0 2024-04-13T02:46:14.228 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:14.228 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:46:14.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.228+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f49b406c8f0 msgr2=0x7f49b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.228+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f49b406c8f0 0x7f49b406edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009f20 tx=0x7f49c40094d0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.228+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 msgr2=0x7f49d4158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.228+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 0x7f49d4158930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009870 tx=0x7f49cc0046c0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 shutdown_connections 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d415ca20 0x7f49d4158930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f49d40b5a10 0x7f49d41583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f49b406c8f0 0x7f49b406edb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 --2- 172.21.15.114:0/1335641602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f49d409b140 0x7f49d41545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 >> 172.21.15.114:0/1335641602 conn(0x7f49d40b4400 msgr2=0x7f49d4160e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 shutdown_connections 2024-04-13T02:46:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.229+0000 7f49d8d88640 1 -- 172.21.15.114:0/1335641602 wait complete. 2024-04-13T02:46:14.240 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-13T02:46:13.506792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220924,"kb_used_data":4728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753796,"statfs":{"total":773094113280,"available":772867887104,"internally_reserved":0,"allocated":4841472,"data_stored":2660856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40392,"num_objects":-31,"num_object_clones":0,"num_object_copies":-62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31,"num_whiteouts":0,"num_read":-31,"num_read_kb":-34,"num_write":-145,"num_write_kb":-101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000966"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T02:46:11.155838+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:46:11.155838+0000","last_peered":"2024-04-13T02:46:11.155838+0000","last_clean":"2024-04-13T02:46:11.155838+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:46:11.155838+0000","last_undegraded":"2024-04-13T02:46:11.155838+0000","last_fullsized":"2024-04-13T02:46:11.155838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":180087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:46:14.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-13T02:46:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.342+0000 7ff8960de640 1 Processor -- start 2024-04-13T02:46:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.342+0000 7ff8960de640 1 -- start start 2024-04-13T02:46:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff8960de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff89006bf80 0x7ff89015f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff8960de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8900b6b20 con 0x7ff89006bba0 2024-04-13T02:46:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff8960de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff890162690 con 0x7ff890162e70 2024-04-13T02:46:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff8960de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7ff8900b0610 con 0x7ff89006bf80 2024-04-13T02:46:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff887fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff89006bf80 0x7ff89015f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff887fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff89006bf80 0x7ff89015f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34336/0 (socket says 172.21.15.114:34336) 2024-04-13T02:46:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff887fff640 1 -- 172.21.15.114:0/660803283 learned_addr learned my addr 172.21.15.114:0/660803283 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff887fff640 1 -- 172.21.15.114:0/660803283 >> v1:172.21.15.130:6789/0 conn(0x7ff890162e70 legacy=0x7ff8900d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff887fff640 1 -- 172.21.15.114:0/660803283 >> v1:172.21.15.114:6789/0 conn(0x7ff89006bba0 legacy=0x7ff8900b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff887fff640 1 -- 172.21.15.114:0/660803283 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8900b0860 con 0x7ff89006bf80 2024-04-13T02:46:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.343+0000 7ff88effd640 1 -- 172.21.15.114:0/660803283 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797825309 0 0) 0x7ff8900b6b20 con 0x7ff89006bba0 2024-04-13T02:46:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.344+0000 7ff887fff640 1 --2- 172.21.15.114:0/660803283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bf80 0x7ff89015f940 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff878009870 tx=0x7ff87802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f691a3a84cdc5743 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.344+0000 7ff88effd640 1 -- 172.21.15.114:0/660803283 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878034070 con 0x7ff89006bf80 2024-04-13T02:46:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.344+0000 7ff88effd640 1 -- 172.21.15.114:0/660803283 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff878030860 con 0x7ff89006bf80 2024-04-13T02:46:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.344+0000 7ff88effd640 1 -- 172.21.15.114:0/660803283 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878030c30 con 0x7ff89006bf80 2024-04-13T02:46:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 -- 172.21.15.114:0/660803283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bf80 msgr2=0x7ff89015f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 --2- 172.21.15.114:0/660803283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bf80 0x7ff89015f940 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff878009870 tx=0x7ff87802b9a0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 -- 172.21.15.114:0/660803283 shutdown_connections 2024-04-13T02:46:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 --2- 172.21.15.114:0/660803283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bf80 0x7ff89015f940 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 -- 172.21.15.114:0/660803283 >> 172.21.15.114:0/660803283 conn(0x7ff890073720 msgr2=0x7ff89009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 -- 172.21.15.114:0/660803283 shutdown_connections 2024-04-13T02:46:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.345+0000 7ff8960de640 1 -- 172.21.15.114:0/660803283 wait complete. 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.346+0000 7ff8960de640 1 Processor -- start 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.346+0000 7ff8960de640 1 -- start start 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff8960de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 0x7ff8901541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff8960de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff89006bf80 0x7ff8900b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff8960de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff890162e70 0x7ff89015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff8960de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900b0e20 con 0x7ff89006bba0 2024-04-13T02:46:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff8960de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8901629e0 con 0x7ff890162e70 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff8960de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff89015fe80 con 0x7ff89006bf80 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 0x7ff8901541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 0x7ff8901541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34348/0 (socket says 172.21.15.114:34348) 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 -- 172.21.15.114:0/53942192 learned_addr learned my addr 172.21.15.114:0/53942192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88ffff640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff890162e70 0x7ff89015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff887fff640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff89006bf80 0x7ff8900b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 -- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff89006bf80 msgr2=0x7ff8900b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff89006bf80 0x7ff8900b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 -- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff890162e70 msgr2=0x7ff89015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff890162e70 0x7ff89015e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff88f7fe640 1 -- 172.21.15.114:0/53942192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89015a450 con 0x7ff89006bba0 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.347+0000 7ff887fff640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff89006bf80 0x7ff8900b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.348+0000 7ff88f7fe640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 0x7ff8901541e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c3c0 tx=0x7ff88000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.348+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880017070 con 0x7ff89006bba0 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.348+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8800035f0 con 0x7ff89006bba0 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.348+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8800039e0 con 0x7ff89006bba0 2024-04-13T02:46:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.348+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8900b4ad0 con 0x7ff89006bba0 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.348+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89015a9a0 con 0x7ff89006bba0 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.349+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff890068c80 con 0x7ff89006bba0 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.349+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff88001a070 con 0x7ff89006bba0 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.350+0000 7ff88cff9640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff87006c920 0x7ff87006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.350+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7ff88008ab60 con 0x7ff89006bba0 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.350+0000 7ff887fff640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff87006c920 0x7ff87006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.350+0000 7ff887fff640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff87006c920 0x7ff87006ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff878036000 tx=0x7ff878008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.354+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff880058be0 con 0x7ff89006bba0 2024-04-13T02:46:14.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.538+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8900b5c40 con 0x7ff89006bba0 2024-04-13T02:46:14.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.539+0000 7ff88cff9640 1 -- 172.21.15.114:0/53942192 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+13190 (secure 0 0 0) 0x7ff88005cee0 con 0x7ff89006bba0 2024-04-13T02:46:14.539 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:14.540 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"fsid":"202cca92-4b79-424a-b5f1-59b181ba42ec","created":"2024-04-13T02:44:15.299249+0000","modified":"2024-04-13T02:46:11.151354+0000","last_up_change":"2024-04-13T02:44:26.510411+0000","last_in_change":"2024-04-13T02:44:17.558879+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-13T02:44:27.502094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e715281c-364f-497c-9ee4-bc8cab07ab2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6812","nonce":2757198995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6816","nonce":2757198995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6823","nonce":2757198995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2757198995},{"type":"v1","addr":"172.21.15.114:6820","nonce":2757198995}]},"public_addr":"172.21.15.114:6812/2757198995","cluster_addr":"172.21.15.114:6816/2757198995","heartbeat_back_addr":"172.21.15.114:6823/2757198995","heartbeat_front_addr":"172.21.15.114:6820/2757198995","state":["exists","up"]},{"osd":1,"uuid":"98224648-a331-467f-bd9a-58835b07bd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6801","nonce":3111631753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6803","nonce":3111631753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6808","nonce":3111631753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3111631753},{"type":"v1","addr":"172.21.15.114:6805","nonce":3111631753}]},"public_addr":"172.21.15.114:6801/3111631753","cluster_addr":"172.21.15.114:6803/3111631753","heartbeat_back_addr":"172.21.15.114:6808/3111631753","heartbeat_front_addr":"172.21.15.114:6805/3111631753","state":["exists","up"]},{"osd":2,"uuid":"b38bbf8b-12ce-4efe-bef2-1f9064ecf87e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6825","nonce":180657889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6827","nonce":180657889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6831","nonce":180657889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":180657889},{"type":"v1","addr":"172.21.15.114:6829","nonce":180657889}]},"public_addr":"172.21.15.114:6825/180657889","cluster_addr":"172.21.15.114:6827/180657889","heartbeat_back_addr":"172.21.15.114:6831/180657889","heartbeat_front_addr":"172.21.15.114:6829/180657889","state":["exists","up"]},{"osd":3,"uuid":"7448c049-42b1-427b-9e16-0cdf568f0988","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6807","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6809","nonce":1156508834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6813","nonce":1156508834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6821","nonce":1156508834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":1156508834},{"type":"v1","addr":"172.21.15.114:6817","nonce":1156508834}]},"public_addr":"172.21.15.114:6809/1156508834","cluster_addr":"172.21.15.114:6813/1156508834","heartbeat_back_addr":"172.21.15.114:6821/1156508834","heartbeat_front_addr":"172.21.15.114:6817/1156508834","state":["exists","up"]},{"osd":4,"uuid":"be7127fd-e876-4384-8b8d-cccb93fa39e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6801","nonce":3673343722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6803","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6805","nonce":3673343722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6813","nonce":3673343722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6807","nonce":3673343722},{"type":"v1","addr":"172.21.15.130:6809","nonce":3673343722}]},"public_addr":"172.21.15.130:6801/3673343722","cluster_addr":"172.21.15.130:6805/3673343722","heartbeat_back_addr":"172.21.15.130:6813/3673343722","heartbeat_front_addr":"172.21.15.130:6809/3673343722","state":["exists","up"]},{"osd":5,"uuid":"003c41bf-63ce-4095-a52c-c328836f0e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6804","nonce":2468914972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6808","nonce":2468914972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6815","nonce":2468914972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":2468914972},{"type":"v1","addr":"172.21.15.130:6812","nonce":2468914972}]},"public_addr":"172.21.15.130:6804/2468914972","cluster_addr":"172.21.15.130:6808/2468914972","heartbeat_back_addr":"172.21.15.130:6815/2468914972","heartbeat_front_addr":"172.21.15.130:6812/2468914972","state":["exists","up"]},{"osd":6,"uuid":"d5473983-9cb8-4e06-850a-fcd74d360899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6817","nonce":576238142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6819","nonce":576238142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6823","nonce":576238142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":576238142},{"type":"v1","addr":"172.21.15.130:6821","nonce":576238142}]},"public_addr":"172.21.15.130:6817/576238142","cluster_addr":"172.21.15.130:6819/576238142","heartbeat_back_addr":"172.21.15.130:6823/576238142","heartbeat_front_addr":"172.21.15.130:6821/576238142","state":["exists","up"]},{"osd":7,"uuid":"4a10c98c-0501-4217-aef9-7461f0b76222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6825","nonce":1928234772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6827","nonce":1928234772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6831","nonce":1928234772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1928234772},{"type":"v1","addr":"172.21.15.130:6829","nonce":1928234772}]},"public_addr":"172.21.15.130:6825/1928234772","cluster_addr":"172.21.15.130:6827/1928234772","heartbeat_back_addr":"172.21.15.130:6831/1928234772","heartbeat_front_addr":"172.21.15.130:6829/1928234772","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.783103+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.711211+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.768224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.719205+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.687981+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.726761+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.740551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-13T02:44:22.808259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6836/3142738723":"2024-04-14T02:46:07.075497+0000","172.21.15.114:6834/3142738723":"2024-04-14T02:46:07.075497+0000","172.21.15.114:6837/2419206521":"2024-04-14T02:46:00.090906+0000","172.21.15.114:6835/2419206521":"2024-04-14T02:46:00.090906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff87006c920 msgr2=0x7ff87006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff87006c920 0x7ff87006ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff878036000 tx=0x7ff878008030 comp rx=0 tx=0).stop 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 msgr2=0x7ff8901541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 0x7ff8901541e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c3c0 tx=0x7ff88000c880 comp rx=0 tx=0).stop 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 shutdown_connections 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff890162e70 0x7ff89015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7ff87006c920 0x7ff87006ede0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff89006bf80 0x7ff8900b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 --2- 172.21.15.114:0/53942192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff89006bba0 0x7ff8901541e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 >> 172.21.15.114:0/53942192 conn(0x7ff890073720 msgr2=0x7ff890155100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 shutdown_connections 2024-04-13T02:46:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:14.541+0000 7ff8960de640 1 -- 172.21.15.114:0/53942192 wait complete. 2024-04-13T02:46:15.554 INFO:tasks.ceph:Scrubbing osd.0 2024-04-13T02:46:15.554 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 Processor -- start 2024-04-13T02:46:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 -- start start 2024-04-13T02:46:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f51240b3ff0 0x7f51240d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 0x7f51240d4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240d2280 con 0x7f51240d4eb0 2024-04-13T02:46:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f51240d5320 con 0x7f51240b3ff0 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.661+0000 7f5129bc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f51240b7930 con 0x7f51240d4210 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f5123fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f51240d4eb0 0x7f51240d2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53224/0 (socket says 172.21.15.114:53224) 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f5123fff640 1 -- 172.21.15.114:0/3263398991 learned_addr learned my addr 172.21.15.114:0/3263398991 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51237fe640 1 --2- 172.21.15.114:0/3263398991 >> v2:172.21.15.130:3300/0 conn(0x7f51240b3ff0 0x7f51240d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f5122ffd640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 0x7f51240d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515632141 0 0) 0x7f51240d2280 con 0x7f51240d4eb0 2024-04-13T02:46:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f510c003520 con 0x7f51240d4eb0 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997248670 0 0) 0x7f510c003520 con 0x7f51240d4eb0 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 msgr2=0x7f51240d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 0x7f51240d4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 >> v2:172.21.15.130:3300/0 conn(0x7f51240b3ff0 msgr2=0x7f51240d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 --2- 172.21.15.114:0/3263398991 >> v2:172.21.15.130:3300/0 conn(0x7f51240b3ff0 0x7f51240d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51240b7b60 con 0x7f51240d4eb0 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f511c0019f0 con 0x7f51240d4eb0 2024-04-13T02:46:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 >> v1:172.21.15.114:6789/0 conn(0x7f51240d4eb0 legacy=0x7f51240d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 0x7f510c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c003f30 0x7f510c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d5320 con 0x7f510c004d40 2024-04-13T02:46:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00b9c0 con 0x7f510c003f30 2024-04-13T02:46:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f510c00bb90 con 0x7f51240d4210 2024-04-13T02:46:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f5123fff640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f51237fe640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 0x7f510c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.662+0000 7f5122ffd640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c003f30 0x7f510c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f5123fff640 1 -- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 msgr2=0x7f510c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:15.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f5123fff640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51240d4210 0x7f510c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f5123fff640 1 -- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c003f30 msgr2=0x7f510c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:15.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f5123fff640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c003f30 0x7f510c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f5123fff640 1 -- 172.21.15.114:0/3263398991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c003520 con 0x7f510c004d40 2024-04-13T02:46:15.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f5123fff640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f511c00a890 tx=0x7f510c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71495931c7da1ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.663+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c00a4e0 con 0x7f510c004d40 2024-04-13T02:46:15.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c034650 con 0x7f510c004d40 2024-04-13T02:46:15.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f51227fc640 1 -- 172.21.15.114:0/3263398991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c034a40 con 0x7f510c004d40 2024-04-13T02:46:15.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5129bc8640 1 -- 172.21.15.114:0/3263398991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f510c004d40 msgr2=0x7f510c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5129bc8640 1 --2- 172.21.15.114:0/3263398991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f510c004d40 0x7f510c0051c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f511c00a890 tx=0x7f510c005830 comp rx=0 tx=0).stop 2024-04-13T02:46:15.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5123fff640 1 -- 172.21.15.114:0/3263398991 reap_dead start 2024-04-13T02:46:15.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5129bc8640 1 -- 172.21.15.114:0/3263398991 shutdown_connections 2024-04-13T02:46:15.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5129bc8640 1 -- 172.21.15.114:0/3263398991 >> 172.21.15.114:0/3263398991 conn(0x7f5124073480 msgr2=0x7f5124073890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:15.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5129bc8640 1 -- 172.21.15.114:0/3263398991 shutdown_connections 2024-04-13T02:46:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.664+0000 7f5129bc8640 1 -- 172.21.15.114:0/3263398991 wait complete. 2024-04-13T02:46:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.665+0000 7f5129bc8640 1 Processor -- start 2024-04-13T02:46:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 -- start start 2024-04-13T02:46:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c004d40 0x7f51241e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51241e9d70 0x7f51241e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51241ea1f0 0x7f51241e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d1fa0 con 0x7f51241ea1f0 2024-04-13T02:46:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d1cc0 con 0x7f510c004d40 2024-04-13T02:46:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5129bc8640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f51240d4670 con 0x7f51241e9d70 2024-04-13T02:46:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5123fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51241ea1f0 0x7f51241e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5123fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51241ea1f0 0x7f51241e4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34366/0 (socket says 172.21.15.114:34366) 2024-04-13T02:46:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.666+0000 7f5123fff640 1 -- 172.21.15.114:0/1297429367 learned_addr learned my addr 172.21.15.114:0/1297429367 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f51237fe640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c004d40 0x7f51241e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5122ffd640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51241e9d70 0x7f51241e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5123fff640 1 -- 172.21.15.114:0/1297429367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51241e9d70 msgr2=0x7f51241e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5123fff640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51241e9d70 0x7f51241e47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5123fff640 1 -- 172.21.15.114:0/1297429367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c004d40 msgr2=0x7f51241e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5123fff640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f510c004d40 0x7f51241e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5123fff640 1 -- 172.21.15.114:0/1297429367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51240c8690 con 0x7f51241ea1f0 2024-04-13T02:46:15.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5123fff640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51241ea1f0 0x7f51241e4ce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f511c00a890 tx=0x7f511c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c0019c0 con 0x7f51241ea1f0 2024-04-13T02:46:15.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c03a040 con 0x7f51241ea1f0 2024-04-13T02:46:15.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51241f5230 con 0x7f51241ea1f0 2024-04-13T02:46:15.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c034a20 con 0x7f51241ea1f0 2024-04-13T02:46:15.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.667+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51240c8c30 con 0x7f51241ea1f0 2024-04-13T02:46:15.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.668+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51241e5220 con 0x7f51241ea1f0 2024-04-13T02:46:15.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.668+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f511c047020 con 0x7f51241ea1f0 2024-04-13T02:46:15.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f510bfff640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f511006c8f0 0x7f511006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f51237fe640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f511006c8f0 0x7f511006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f511c0ad290 con 0x7f51241ea1f0 2024-04-13T02:46:15.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f510bfff640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7f5110072850 0x7f5110074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 --> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f511c04be80 con 0x7f5110072850 2024-04-13T02:46:15.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f511c0b4050 con 0x7f51241ea1f0 2024-04-13T02:46:15.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f5122ffd640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7f5110072850 0x7f5110074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f51237fe640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f511006c8f0 0x7f511006edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51240b98d0 tx=0x7f5114008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.669+0000 7f5122ffd640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7f5110072850 0x7f5110074c70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.670+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== osd.0 v2:172.21.15.114:6810/2757198995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f511c04be80 con 0x7f5110072850 2024-04-13T02:46:15.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.683+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 --> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f51241e5990 con 0x7f5110072850 2024-04-13T02:46:15.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.683+0000 7f510bfff640 1 -- 172.21.15.114:0/1297429367 <== osd.0 v2:172.21.15.114:6810/2757198995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f51241e5990 con 0x7f5110072850 2024-04-13T02:46:15.689 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:15.690 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:15.690 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:15.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.683+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7f5110072850 msgr2=0x7f5110074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.683+0000 7f5129bc8640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6810/2757198995,v1:172.21.15.114:6812/2757198995] conn(0x7f5110072850 0x7f5110074c70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f511006c8f0 msgr2=0x7f511006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f511006c8f0 0x7f511006edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51240b98d0 tx=0x7f5114008040 comp rx=0 tx=0).stop 2024-04-13T02:46:15.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51241ea1f0 msgr2=0x7f51241e4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 --2- 172.21.15.114:0/1297429367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51241ea1f0 0x7f51241e4ce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f511c00a890 tx=0x7f511c001360 comp rx=0 tx=0).stop 2024-04-13T02:46:15.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5123fff640 1 -- 172.21.15.114:0/1297429367 reap_dead start 2024-04-13T02:46:15.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 shutdown_connections 2024-04-13T02:46:15.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 >> 172.21.15.114:0/1297429367 conn(0x7f5124073480 msgr2=0x7f51240b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:15.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 shutdown_connections 2024-04-13T02:46:15.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.684+0000 7f5129bc8640 1 -- 172.21.15.114:0/1297429367 wait complete. 2024-04-13T02:46:15.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-13T02:46:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.796+0000 7f4ad711e640 1 Processor -- start 2024-04-13T02:46:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.796+0000 7f4ad711e640 1 -- start start 2024-04-13T02:46:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad711e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad711e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4ad00cfc10 0x7f4ad0072990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad711e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad015c450 con 0x7f4ad0072ed0 2024-04-13T02:46:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad711e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad00b5c70 con 0x7f4ad00cfc10 2024-04-13T02:46:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad711e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad0070230 con 0x7f4ad0158980 2024-04-13T02:46:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4ad00cfc10 0x7f4ad0072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4ad00cfc10 0x7f4ad0072990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34374/0 (socket says 172.21.15.114:34374) 2024-04-13T02:46:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad56bb640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4ad0072ed0 0x7f4ad00b3d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53230/0 (socket says 172.21.15.114:53230) 2024-04-13T02:46:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 -- 172.21.15.114:0/1405482871 learned_addr learned my addr 172.21.15.114:0/1405482871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4ad4eba640 1 --2- 172.21.15.114:0/1405482871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 -- 172.21.15.114:0/1405482871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 msgr2=0x7f4ad015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 --2- 172.21.15.114:0/1405482871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad015bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 -- 172.21.15.114:0/1405482871 >> v1:172.21.15.114:6789/0 conn(0x7f4ad0072ed0 legacy=0x7f4ad00b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.797+0000 7f4acffff640 1 -- 172.21.15.114:0/1405482871 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad00cf130 con 0x7f4ad00cfc10 2024-04-13T02:46:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4acffff640 1 --2- 172.21.15.114:0/1405482871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad00cfc10 0x7f4ad0072990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00aa10 tx=0x7f4abc02ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc131698224025d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4acf7fe640 1 -- 172.21.15.114:0/1405482871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc03a070 con 0x7f4ad00cfc10 2024-04-13T02:46:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4acf7fe640 1 -- 172.21.15.114:0/1405482871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc02dc10 con 0x7f4ad00cfc10 2024-04-13T02:46:15.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4acf7fe640 1 -- 172.21.15.114:0/1405482871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00b040 con 0x7f4ad00cfc10 2024-04-13T02:46:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4ad711e640 1 -- 172.21.15.114:0/1405482871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad00cfc10 msgr2=0x7f4ad0072990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1405482871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad00cfc10 0x7f4ad0072990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00aa10 tx=0x7f4abc02ce60 comp rx=0 tx=0).stop 2024-04-13T02:46:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4ad711e640 1 -- 172.21.15.114:0/1405482871 shutdown_connections 2024-04-13T02:46:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1405482871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad00cfc10 0x7f4ad0072990 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1405482871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.798+0000 7f4ad711e640 1 -- 172.21.15.114:0/1405482871 >> 172.21.15.114:0/1405482871 conn(0x7f4ad00b2460 msgr2=0x7f4ad00b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.799+0000 7f4ad711e640 1 -- 172.21.15.114:0/1405482871 shutdown_connections 2024-04-13T02:46:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.799+0000 7f4ad711e640 1 -- 172.21.15.114:0/1405482871 wait complete. 2024-04-13T02:46:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.800+0000 7f4ad711e640 1 Processor -- start 2024-04-13T02:46:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.800+0000 7f4ad711e640 1 -- start start 2024-04-13T02:46:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 0x7f4ad01f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad00cfc10 0x7f4ad00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad0154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad00cee20 con 0x7f4ad0072ed0 2024-04-13T02:46:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad00cf6f0 con 0x7f4ad00cfc10 2024-04-13T02:46:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad0158d60 con 0x7f4ad0158980 2024-04-13T02:46:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 0x7f4ad01f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 0x7f4ad01f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34390/0 (socket says 172.21.15.114:34390) 2024-04-13T02:46:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 -- 172.21.15.114:0/1773714120 learned_addr learned my addr 172.21.15.114:0/1773714120 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4acffff640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad00cfc10 0x7f4ad00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad56bb640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad0154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 -- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 msgr2=0x7f4ad0154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad0154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 -- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad00cfc10 msgr2=0x7f4ad00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad00cfc10 0x7f4ad00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 -- 172.21.15.114:0/1773714120 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad00af2f0 con 0x7f4ad0072ed0 2024-04-13T02:46:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad56bb640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad0154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad4eba640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 0x7f4ad01f23b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d620 tx=0x7f4ac400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400b620 con 0x7f4ad0072ed0 2024-04-13T02:46:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac4019070 con 0x7f4ad0072ed0 2024-04-13T02:46:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad014dc40 con 0x7f4ad0072ed0 2024-04-13T02:46:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400b9e0 con 0x7f4ad0072ed0 2024-04-13T02:46:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.801+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad014e200 con 0x7f4ad0072ed0 2024-04-13T02:46:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.802+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad0068c80 con 0x7f4ad0072ed0 2024-04-13T02:46:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.803+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ac400bb80 con 0x7f4ad0072ed0 2024-04-13T02:46:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.803+0000 7f4acd7fa640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4ab406c8f0 0x7f4ab406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.803+0000 7f4acffff640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4ab406c8f0 0x7f4ab406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.803+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f4ac408bc40 con 0x7f4ad0072ed0 2024-04-13T02:46:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.803+0000 7f4acffff640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4ab406c8f0 0x7f4ab406edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4abc037000 tx=0x7f4abc031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.807+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ac405a3a0 con 0x7f4ad0072ed0 2024-04-13T02:46:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.982+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4ad0157500 con 0x7f4ab406c8f0 2024-04-13T02:46:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.982+0000 7f4acd7fa640 1 -- 172.21.15.114:0/1773714120 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4ad0157500 con 0x7f4ab406c8f0 2024-04-13T02:46:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 0 to deep-scrub 2024-04-13T02:46:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4ab406c8f0 msgr2=0x7f4ab406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4ab406c8f0 0x7f4ab406edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4abc037000 tx=0x7f4abc031000 comp rx=0 tx=0).stop 2024-04-13T02:46:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 msgr2=0x7f4ad01f23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 0x7f4ad01f23b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d620 tx=0x7f4ac400dae0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 shutdown_connections 2024-04-13T02:46:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f4ab406c8f0 0x7f4ab406edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0158980 0x7f4ad0154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad00cfc10 0x7f4ad00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 --2- 172.21.15.114:0/1773714120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ad0072ed0 0x7f4ad01f23b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 >> 172.21.15.114:0/1773714120 conn(0x7f4ad00b2460 msgr2=0x7f4ad006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 shutdown_connections 2024-04-13T02:46:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:15.984+0000 7f4ad711e640 1 -- 172.21.15.114:0/1773714120 wait complete. 2024-04-13T02:46:15.996 INFO:tasks.ceph:Scrubbing osd.1 2024-04-13T02:46:15.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:16.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.099+0000 7fb10a405640 1 Processor -- start 2024-04-13T02:46:16.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.099+0000 7fb10a405640 1 -- start start 2024-04-13T02:46:16.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.099+0000 7fb10a405640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040afd10 0x7fb10415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb10a405640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1040729e0 0x7fb104072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb10a405640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1040b5480 con 0x7fb1040b3760 2024-04-13T02:46:16.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb10a405640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb10406e160 con 0x7fb1040729e0 2024-04-13T02:46:16.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb10a405640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb1040b3cb0 con 0x7fb1040afd10 2024-04-13T02:46:16.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb103fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040afd10 0x7fb10415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb1089a2640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1040729e0 0x7fb104072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb103fff640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040afd10 0x7fb10415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:49334/0 (socket says 172.21.15.114:49334) 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb103fff640 1 -- 172.21.15.114:0/3905053476 learned_addr learned my addr 172.21.15.114:0/3905053476 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb1089a2640 1 -- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040afd10 msgr2=0x7fb10415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb1089a2640 1 --2- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040afd10 0x7fb10415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb1089a2640 1 -- 172.21.15.114:0/3905053476 >> v1:172.21.15.130:6789/0 conn(0x7fb1040b3760 legacy=0x7fb1040cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.100+0000 7fb1089a2640 1 -- 172.21.15.114:0/3905053476 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1040b3f90 con 0x7fb1040729e0 2024-04-13T02:46:16.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.101+0000 7fb1089a2640 1 --2- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040729e0 0x7fb104072e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00bfa0 tx=0x7fb0fc02e0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3278278312f42bef server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.101+0000 7fb102ffd640 1 -- 172.21.15.114:0/3905053476 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc02ea40 con 0x7fb1040729e0 2024-04-13T02:46:16.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.101+0000 7fb102ffd640 1 -- 172.21.15.114:0/3905053476 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc02ebe0 con 0x7fb1040729e0 2024-04-13T02:46:16.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.101+0000 7fb102ffd640 1 -- 172.21.15.114:0/3905053476 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc009540 con 0x7fb1040729e0 2024-04-13T02:46:16.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 -- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040729e0 msgr2=0x7fb104072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 --2- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040729e0 0x7fb104072e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00bfa0 tx=0x7fb0fc02e0a0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 -- 172.21.15.114:0/3905053476 shutdown_connections 2024-04-13T02:46:16.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 --2- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040729e0 0x7fb104072e70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 --2- 172.21.15.114:0/3905053476 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040afd10 0x7fb10415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 -- 172.21.15.114:0/3905053476 >> 172.21.15.114:0/3905053476 conn(0x7fb1040b2460 msgr2=0x7fb1040b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 -- 172.21.15.114:0/3905053476 shutdown_connections 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.102+0000 7fb10a405640 1 -- 172.21.15.114:0/3905053476 wait complete. 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.103+0000 7fb10a405640 1 Processor -- start 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.103+0000 7fb10a405640 1 -- start start 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb10a405640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1040729e0 0x7fb10415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb10a405640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040afd10 0x7fb104152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb10a405640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040b3760 0x7fb104153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb10a405640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1040b00f0 con 0x7fb1040729e0 2024-04-13T02:46:16.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb10a405640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb1040b4550 con 0x7fb1040afd10 2024-04-13T02:46:16.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb10a405640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb104072150 con 0x7fb1040b3760 2024-04-13T02:46:16.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1040729e0 0x7fb10415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1040729e0 0x7fb10415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34398/0 (socket says 172.21.15.114:34398) 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 -- 172.21.15.114:0/3457783489 learned_addr learned my addr 172.21.15.114:0/3457783489 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb1089a2640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040b3760 0x7fb104153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb1037fe640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040afd10 0x7fb104152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 -- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040b3760 msgr2=0x7fb104153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040b3760 0x7fb104153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 -- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040afd10 msgr2=0x7fb104152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040afd10 0x7fb104152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 -- 172.21.15.114:0/3457783489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb104155cc0 con 0x7fb1040729e0 2024-04-13T02:46:16.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb1089a2640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1040b3760 0x7fb104153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb1037fe640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1040afd10 0x7fb104152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb103fff640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1040729e0 0x7fb10415de00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009fd0 tx=0x7fb0f400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.104+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4017070 con 0x7fb1040729e0 2024-04-13T02:46:16.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.105+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f400c940 con 0x7fb1040729e0 2024-04-13T02:46:16.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.105+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb104155f60 con 0x7fb1040729e0 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.105+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400cd10 con 0x7fb1040729e0 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.105+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb104156520 con 0x7fb1040729e0 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.105+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb104068db0 con 0x7fb1040729e0 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0f401a070 con 0x7fb1040729e0 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb100ff9640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb0f006c8f0 0x7fb0f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fb0f408b790 con 0x7fb1040729e0 2024-04-13T02:46:16.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb1037fe640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb0f006c8f0 0x7fb0f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb100ff9640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7fb0f0072850 0x7fb0f0074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 --> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0f0075320 con 0x7fb0f0072850 2024-04-13T02:46:16.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.106+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb0f40902c0 con 0x7fb1040729e0 2024-04-13T02:46:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.107+0000 7fb1089a2640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7fb0f0072850 0x7fb0f0074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.107+0000 7fb1037fe640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb0f006c8f0 0x7fb0f006edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1041f8f90 tx=0x7fb0f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.107+0000 7fb1089a2640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7fb0f0072850 0x7fb0f0074c70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.108+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== osd.1 v2:172.21.15.114:6800/3111631753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb0f0075320 con 0x7fb0f0072850 2024-04-13T02:46:16.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.120+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 --> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb10406fa10 con 0x7fb0f0072850 2024-04-13T02:46:16.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb100ff9640 1 -- 172.21.15.114:0/3457783489 <== osd.1 v2:172.21.15.114:6800/3111631753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb10406fa10 con 0x7fb0f0072850 2024-04-13T02:46:16.122 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:16.122 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:16.123 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:16.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7fb0f0072850 msgr2=0x7fb0f0074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6800/3111631753,v1:172.21.15.114:6801/3111631753] conn(0x7fb0f0072850 0x7fb0f0074c70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb0f006c8f0 msgr2=0x7fb0f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fb0f006c8f0 0x7fb0f006edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1041f8f90 tx=0x7fb0f8009040 comp rx=0 tx=0).stop 2024-04-13T02:46:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1040729e0 msgr2=0x7fb10415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 --2- 172.21.15.114:0/3457783489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1040729e0 0x7fb10415de00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009fd0 tx=0x7fb0f400ed40 comp rx=0 tx=0).stop 2024-04-13T02:46:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb1089a2640 1 -- 172.21.15.114:0/3457783489 reap_dead start 2024-04-13T02:46:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 shutdown_connections 2024-04-13T02:46:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 >> 172.21.15.114:0/3457783489 conn(0x7fb1040b2460 msgr2=0x7fb1040cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 shutdown_connections 2024-04-13T02:46:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.121+0000 7fb10a405640 1 -- 172.21.15.114:0/3457783489 wait complete. 2024-04-13T02:46:16.132 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-13T02:46:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.233+0000 7f6e7da6d640 1 Processor -- start 2024-04-13T02:46:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.233+0000 7f6e7da6d640 1 -- start start 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e7da6d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e780afff0 0x7f6e780cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e7da6d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e7da6d640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e780cfd50 con 0x7f6e7815c130 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e7da6d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f6e780b3f30 con 0x7f6e780afff0 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e7da6d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6e780b4210 con 0x7f6e78144e40 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e780afff0 0x7f6e780cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e780afff0 0x7f6e780cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34400/0 (socket says 172.21.15.114:34400) 2024-04-13T02:46:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 -- 172.21.15.114:0/2151836200 learned_addr learned my addr 172.21.15.114:0/2151836200 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/2151836200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 -- 172.21.15.114:0/2151836200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 msgr2=0x7f6e7815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 --2- 172.21.15.114:0/2151836200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 -- 172.21.15.114:0/2151836200 >> v1:172.21.15.130:6789/0 conn(0x7f6e7815c130 legacy=0x7f6e7806f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.234+0000 7f6e777fe640 1 -- 172.21.15.114:0/2151836200 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e780d0030 con 0x7f6e780afff0 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.235+0000 7f6e777fe640 1 --2- 172.21.15.114:0/2151836200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e780cf690 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009870 tx=0x7f6e6802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1db9f644c104ac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.235+0000 7f6e767fc640 1 -- 172.21.15.114:0/2151836200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e680317c0 con 0x7f6e780afff0 2024-04-13T02:46:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.235+0000 7f6e767fc640 1 -- 172.21.15.114:0/2151836200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e68037070 con 0x7f6e780afff0 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.235+0000 7f6e767fc640 1 -- 172.21.15.114:0/2151836200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68031b80 con 0x7f6e780afff0 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 -- 172.21.15.114:0/2151836200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 msgr2=0x7f6e780cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/2151836200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e780cf690 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009870 tx=0x7f6e6802b860 comp rx=0 tx=0).stop 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 -- 172.21.15.114:0/2151836200 shutdown_connections 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/2151836200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/2151836200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e780cf690 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 -- 172.21.15.114:0/2151836200 >> 172.21.15.114:0/2151836200 conn(0x7f6e780b2460 msgr2=0x7f6e780b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 -- 172.21.15.114:0/2151836200 shutdown_connections 2024-04-13T02:46:16.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.236+0000 7f6e7da6d640 1 -- 172.21.15.114:0/2151836200 wait complete. 2024-04-13T02:46:16.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.237+0000 7f6e7da6d640 1 Processor -- start 2024-04-13T02:46:16.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.237+0000 7f6e7da6d640 1 -- start start 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e7813aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7813e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815c130 0x7f6e7813e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e78145420 con 0x7f6e780afff0 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6e781452a0 con 0x7f6e7815c130 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7806f920 con 0x7f6e78144e40 2024-04-13T02:46:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e7813aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e7813aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34414/0 (socket says 172.21.15.114:34414) 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 -- 172.21.15.114:0/3652279815 learned_addr learned my addr 172.21.15.114:0/3652279815 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e77fff640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815c130 0x7f6e7813e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7813e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 -- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 msgr2=0x7f6e7813e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7813e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 -- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815c130 msgr2=0x7f6e7813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815c130 0x7f6e7813e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 -- 172.21.15.114:0/3652279815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e78140de0 con 0x7f6e780afff0 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7813e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e777fe640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e7813aeb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68032860 con 0x7f6e780afff0 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e68032a20 con 0x7f6e780afff0 2024-04-13T02:46:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.238+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e781410c0 con 0x7f6e780afff0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.239+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68032e10 con 0x7f6e780afff0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.239+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e78141680 con 0x7f6e780afff0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.239+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e781418c0 con 0x7f6e780afff0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.240+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e6804c060 con 0x7f6e780afff0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.240+0000 7f6e5ffff640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c8f0 0x7f6e6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.240+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f6e680ad030 con 0x7f6e780afff0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.240+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c8f0 0x7f6e6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.241+0000 7f6e76ffd640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c8f0 0x7f6e6406edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e781446e0 tx=0x7f6e6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.245+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e781418c0 con 0x7f6e780afff0 2024-04-13T02:46:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.419+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6e7815ef50 con 0x7f6e6406c8f0 2024-04-13T02:46:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.419+0000 7f6e5ffff640 1 -- 172.21.15.114:0/3652279815 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6e7815ef50 con 0x7f6e6406c8f0 2024-04-13T02:46:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 1 to deep-scrub 2024-04-13T02:46:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c8f0 msgr2=0x7f6e6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c8f0 0x7f6e6406edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e781446e0 tx=0x7f6e6c008040 comp rx=0 tx=0).stop 2024-04-13T02:46:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 msgr2=0x7f6e7813aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e7813aeb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e680046c0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 shutdown_connections 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e7815c130 0x7f6e7813e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f6e6406c8f0 0x7f6e6406edb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6e78144e40 0x7f6e7813e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 --2- 172.21.15.114:0/3652279815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e780afff0 0x7f6e7813aeb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 >> 172.21.15.114:0/3652279815 conn(0x7f6e780b2460 msgr2=0x7f6e780b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 shutdown_connections 2024-04-13T02:46:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.421+0000 7f6e7da6d640 1 -- 172.21.15.114:0/3652279815 wait complete. 2024-04-13T02:46:16.432 INFO:tasks.ceph:Scrubbing osd.2 2024-04-13T02:46:16.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 Processor -- start 2024-04-13T02:46:16.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 -- start start 2024-04-13T02:46:16.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc4e015fdb0 0x7fc4e006f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4e00cfe30 0x7fc4e015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e0160190 con 0x7fc4e006f7b0 2024-04-13T02:46:16.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e0072b90 con 0x7fc4e00cfe30 2024-04-13T02:46:16.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.536+0000 7fc4e50ad640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e00d0280 con 0x7fc4e015fdb0 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4e00cfe30 0x7fc4e015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4e00cfe30 0x7fc4e015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34422/0 (socket says 172.21.15.114:34422) 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 -- 172.21.15.114:0/2295471935 learned_addr learned my addr 172.21.15.114:0/2295471935 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4ded9d640 1 --2- 172.21.15.114:0/2295471935 >> v2:172.21.15.130:3300/0 conn(0x7fc4e015fdb0 0x7fc4e006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 -- 172.21.15.114:0/2295471935 >> v2:172.21.15.130:3300/0 conn(0x7fc4e015fdb0 msgr2=0x7fc4e006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 --2- 172.21.15.114:0/2295471935 >> v2:172.21.15.130:3300/0 conn(0x7fc4e015fdb0 0x7fc4e006f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 -- 172.21.15.114:0/2295471935 >> v1:172.21.15.130:6789/0 conn(0x7fc4e006f7b0 legacy=0x7fc4e00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4df59e640 1 -- 172.21.15.114:0/2295471935 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e00d04e0 con 0x7fc4e00cfe30 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.537+0000 7fc4ded9d640 1 --2- 172.21.15.114:0/2295471935 >> v2:172.21.15.130:3300/0 conn(0x7fc4e015fdb0 0x7fc4e006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4df59e640 1 --2- 172.21.15.114:0/2295471935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e00cfe30 0x7fc4e015bbc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800d150 tx=0x7fc4d802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58571eba1de970fa server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4ddd9b640 1 -- 172.21.15.114:0/2295471935 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d802ea80 con 0x7fc4e00cfe30 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4ddd9b640 1 -- 172.21.15.114:0/2295471935 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d802ec20 con 0x7fc4e00cfe30 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4ddd9b640 1 -- 172.21.15.114:0/2295471935 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8009600 con 0x7fc4e00cfe30 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 -- 172.21.15.114:0/2295471935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e00cfe30 msgr2=0x7fc4e015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 --2- 172.21.15.114:0/2295471935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e00cfe30 0x7fc4e015bbc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800d150 tx=0x7fc4d802e0e0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 -- 172.21.15.114:0/2295471935 shutdown_connections 2024-04-13T02:46:16.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 --2- 172.21.15.114:0/2295471935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e00cfe30 0x7fc4e015bbc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 --2- 172.21.15.114:0/2295471935 >> v2:172.21.15.130:3300/0 conn(0x7fc4e015fdb0 0x7fc4e006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 -- 172.21.15.114:0/2295471935 >> 172.21.15.114:0/2295471935 conn(0x7fc4e00b2460 msgr2=0x7fc4e00b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 -- 172.21.15.114:0/2295471935 shutdown_connections 2024-04-13T02:46:16.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.538+0000 7fc4e50ad640 1 -- 172.21.15.114:0/2295471935 wait complete. 2024-04-13T02:46:16.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.540+0000 7fc4e50ad640 1 Processor -- start 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.540+0000 7fc4e50ad640 1 -- start start 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.540+0000 7fc4e50ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e006f7b0 0x7fc4e00aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.540+0000 7fc4e50ad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e00cfe30 0x7fc4e00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.540+0000 7fc4e50ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e015fdb0 0x7fc4e00abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4e50ad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0072260 con 0x7fc4e006f7b0 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4e50ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0073020 con 0x7fc4e015fdb0 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4e50ad640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e0072540 con 0x7fc4e00cfe30 2024-04-13T02:46:16.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e006f7b0 0x7fc4e00aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e006f7b0 0x7fc4e00aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34428/0 (socket says 172.21.15.114:34428) 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 -- 172.21.15.114:0/1369548716 learned_addr learned my addr 172.21.15.114:0/1369548716 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4df59e640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e015fdb0 0x7fc4e00abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4de59c640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e00cfe30 0x7fc4e00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 -- 172.21.15.114:0/1369548716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e00cfe30 msgr2=0x7fc4e00cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc4e00cfe30 0x7fc4e00cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 -- 172.21.15.114:0/1369548716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e015fdb0 msgr2=0x7fc4e00abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e015fdb0 0x7fc4e00abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 -- 172.21.15.114:0/1369548716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e00ab440 con 0x7fc4e006f7b0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4ded9d640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e006f7b0 0x7fc4e00aaf00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c7f0 tx=0x7fc4d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0015070 con 0x7fc4e006f7b0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0007820 con 0x7fc4e006f7b0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e0148530 con 0x7fc4e006f7b0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0007bd0 con 0x7fc4e006f7b0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.541+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e0148af0 con 0x7fc4e006f7b0 2024-04-13T02:46:16.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.542+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4e0068db0 con 0x7fc4e006f7b0 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4d0018070 con 0x7fc4e006f7b0 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4c77fe640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc4cc06c8f0 0x7fc4cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fc4d008b9b0 con 0x7fc4e006f7b0 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4de59c640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc4cc06c8f0 0x7fc4cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4c77fe640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7fc4cc072850 0x7fc4cc074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 --> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4cc075320 con 0x7fc4cc072850 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.543+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc4d00902c0 con 0x7fc4e006f7b0 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.544+0000 7fc4df59e640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7fc4cc072850 0x7fc4cc074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.544+0000 7fc4de59c640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc4cc06c8f0 0x7fc4cc06edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc4e01f3ca0 tx=0x7fc4d4007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.544+0000 7fc4df59e640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7fc4cc072850 0x7fc4cc074c70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.544+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== osd.2 v2:172.21.15.114:6824/180657889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4cc075320 con 0x7fc4cc072850 2024-04-13T02:46:16.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.557+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 --> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc4e00b3880 con 0x7fc4cc072850 2024-04-13T02:46:16.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4c77fe640 1 -- 172.21.15.114:0/1369548716 <== osd.2 v2:172.21.15.114:6824/180657889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc4e00b3880 con 0x7fc4cc072850 2024-04-13T02:46:16.559 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:16.559 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:16.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7fc4cc072850 msgr2=0x7fc4cc074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6824/180657889,v1:172.21.15.114:6825/180657889] conn(0x7fc4cc072850 0x7fc4cc074c70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc4cc06c8f0 msgr2=0x7fc4cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc4cc06c8f0 0x7fc4cc06edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc4e01f3ca0 tx=0x7fc4d4007e30 comp rx=0 tx=0).stop 2024-04-13T02:46:16.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e006f7b0 msgr2=0x7fc4e00aaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 --2- 172.21.15.114:0/1369548716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4e006f7b0 0x7fc4e00aaf00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c7f0 tx=0x7fc4d000ccb0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4df59e640 1 -- 172.21.15.114:0/1369548716 reap_dead start 2024-04-13T02:46:16.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 shutdown_connections 2024-04-13T02:46:16.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 >> 172.21.15.114:0/1369548716 conn(0x7fc4e00b2460 msgr2=0x7fc4e00afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 shutdown_connections 2024-04-13T02:46:16.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.558+0000 7fc4e50ad640 1 -- 172.21.15.114:0/1369548716 wait complete. 2024-04-13T02:46:16.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-13T02:46:16.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.670+0000 7f5b274de640 1 Processor -- start 2024-04-13T02:46:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b274de640 1 -- start start 2024-04-13T02:46:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b274de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b200725b0 0x7f5b2006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b274de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b20072a20 con 0x7f5b2013f6a0 2024-04-13T02:46:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b274de640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2015d200 con 0x7f5b20072100 2024-04-13T02:46:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b274de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f5b200a95b0 con 0x7f5b200725b0 2024-04-13T02:46:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b25a7b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b200725b0 0x7f5b2006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b2527a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5b2013f6a0 0x7f5b200ceda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53242/0 (socket says 172.21.15.114:53242) 2024-04-13T02:46:16.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b2527a640 1 -- 172.21.15.114:0/2739666711 learned_addr learned my addr 172.21.15.114:0/2739666711 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:16.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.671+0000 7f5b25a7b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b200725b0 0x7f5b2006fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34436/0 (socket says 172.21.15.114:34436) 2024-04-13T02:46:16.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.672+0000 7f5b25a7b640 1 -- 172.21.15.114:0/2739666711 >> v1:172.21.15.130:6789/0 conn(0x7f5b20072100 legacy=0x7f5b2006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.672+0000 7f5b25a7b640 1 -- 172.21.15.114:0/2739666711 >> v1:172.21.15.114:6789/0 conn(0x7f5b2013f6a0 legacy=0x7f5b200ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.672+0000 7f5b25a7b640 1 -- 172.21.15.114:0/2739666711 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2015d4e0 con 0x7f5b200725b0 2024-04-13T02:46:16.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.672+0000 7f5b13fff640 1 -- 172.21.15.114:0/2739666711 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677390421 0 0) 0x7f5b20072a20 con 0x7f5b2013f6a0 2024-04-13T02:46:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.672+0000 7f5b25a7b640 1 --2- 172.21.15.114:0/2739666711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b2006fb00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009d90 tx=0x7f5b1802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e597b77d0280ab server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b13fff640 1 -- 172.21.15.114:0/2739666711 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18039070 con 0x7f5b200725b0 2024-04-13T02:46:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b13fff640 1 -- 172.21.15.114:0/2739666711 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1802cd80 con 0x7f5b200725b0 2024-04-13T02:46:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b13fff640 1 -- 172.21.15.114:0/2739666711 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18034660 con 0x7f5b200725b0 2024-04-13T02:46:16.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 -- 172.21.15.114:0/2739666711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 msgr2=0x7f5b2006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 --2- 172.21.15.114:0/2739666711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b2006fb00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009d90 tx=0x7f5b1802bfd0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 -- 172.21.15.114:0/2739666711 shutdown_connections 2024-04-13T02:46:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 --2- 172.21.15.114:0/2739666711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b2006fb00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 -- 172.21.15.114:0/2739666711 >> 172.21.15.114:0/2739666711 conn(0x7f5b200b2460 msgr2=0x7f5b200b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 -- 172.21.15.114:0/2739666711 shutdown_connections 2024-04-13T02:46:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.673+0000 7f5b274de640 1 -- 172.21.15.114:0/2739666711 wait complete. 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.674+0000 7f5b274de640 1 Processor -- start 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.674+0000 7f5b274de640 1 -- start start 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b274de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b20072100 0x7f5b200b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b274de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b201559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b274de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b2013f6a0 0x7f5b20140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b274de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2015dd80 con 0x7f5b200725b0 2024-04-13T02:46:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b274de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2013fef0 con 0x7f5b20072100 2024-04-13T02:46:16.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b274de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2015ce60 con 0x7f5b2013f6a0 2024-04-13T02:46:16.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b201559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b201559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34438/0 (socket says 172.21.15.114:34438) 2024-04-13T02:46:16.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 -- 172.21.15.114:0/406119634 learned_addr learned my addr 172.21.15.114:0/406119634 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b2527a640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b20072100 0x7f5b200b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b25a7b640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b2013f6a0 0x7f5b20140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 -- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b2013f6a0 msgr2=0x7f5b20140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b2013f6a0 0x7f5b20140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 -- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b20072100 msgr2=0x7f5b200b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b20072100 0x7f5b200b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.675+0000 7f5b24a79640 1 -- 172.21.15.114:0/406119634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b200b5220 con 0x7f5b200725b0 2024-04-13T02:46:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b25a7b640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b2013f6a0 0x7f5b20140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b2527a640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b20072100 0x7f5b200b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b24a79640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b201559f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c400 tx=0x7f5b1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c017070 con 0x7f5b200725b0 2024-04-13T02:46:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0052d0 con 0x7f5b200725b0 2024-04-13T02:46:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c003830 con 0x7f5b200725b0 2024-04-13T02:46:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b200b5500 con 0x7f5b200725b0 2024-04-13T02:46:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.676+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b200aded0 con 0x7f5b200725b0 2024-04-13T02:46:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.677+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b20068c80 con 0x7f5b200725b0 2024-04-13T02:46:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.677+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b1c01a070 con 0x7f5b200725b0 2024-04-13T02:46:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.678+0000 7f5b11ffb640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5b0406c8f0 0x7f5b0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.678+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f5b1c08abf0 con 0x7f5b200725b0 2024-04-13T02:46:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.678+0000 7f5b2527a640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5b0406c8f0 0x7f5b0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.678+0000 7f5b2527a640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5b0406c8f0 0x7f5b0406edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5b14000f60 tx=0x7f5b14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.682+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5b1c0592c0 con 0x7f5b200725b0 2024-04-13T02:46:16.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.857+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5b200ae0a0 con 0x7f5b0406c8f0 2024-04-13T02:46:16.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.857+0000 7f5b11ffb640 1 -- 172.21.15.114:0/406119634 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b200ae0a0 con 0x7f5b0406c8f0 2024-04-13T02:46:16.858 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 2 to deep-scrub 2024-04-13T02:46:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5b0406c8f0 msgr2=0x7f5b0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5b0406c8f0 0x7f5b0406edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5b14000f60 tx=0x7f5b14009040 comp rx=0 tx=0).stop 2024-04-13T02:46:16.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 msgr2=0x7f5b201559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b201559f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c400 tx=0x7f5b1c00c8c0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 shutdown_connections 2024-04-13T02:46:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f5b0406c8f0 0x7f5b0406edb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b2013f6a0 0x7f5b20140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b200725b0 0x7f5b201559f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 --2- 172.21.15.114:0/406119634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b20072100 0x7f5b200b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.859+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 >> 172.21.15.114:0/406119634 conn(0x7f5b200b2460 msgr2=0x7f5b200b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.860+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 shutdown_connections 2024-04-13T02:46:16.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.860+0000 7f5b274de640 1 -- 172.21.15.114:0/406119634 wait complete. 2024-04-13T02:46:16.871 INFO:tasks.ceph:Scrubbing osd.3 2024-04-13T02:46:16.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:16.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.974+0000 7f9ea0d5e640 1 Processor -- start 2024-04-13T02:46:16.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.974+0000 7f9ea0d5e640 1 -- start start 2024-04-13T02:46:16.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9ea0d5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e9c1462f0 0x7f9e9c072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9ea0d5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c072690 0x7f9e9c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9ea0d5e640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9e9c0cd680 0x7f9e9c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9ea0d5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9c0a9640 con 0x7f9e9c1462f0 2024-04-13T02:46:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9ea0d5e640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9c072af0 con 0x7f9e9c0cd680 2024-04-13T02:46:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9ea0d5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9c0ce000 con 0x7f9e9c072690 2024-04-13T02:46:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e9c1462f0 0x7f9e9c072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e9c1462f0 0x7f9e9c072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34452/0 (socket says 172.21.15.114:34452) 2024-04-13T02:46:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 -- 172.21.15.114:0/687643401 learned_addr learned my addr 172.21.15.114:0/687643401 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9ad9d640 1 --2- 172.21.15.114:0/687643401 >> v2:172.21.15.130:3300/0 conn(0x7f9e9c0cd680 0x7f9e9c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e99d9b640 1 --2- 172.21.15.114:0/687643401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c072690 0x7f9e9c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 -- 172.21.15.114:0/687643401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c072690 msgr2=0x7f9e9c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 --2- 172.21.15.114:0/687643401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c072690 0x7f9e9c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 -- 172.21.15.114:0/687643401 >> v2:172.21.15.130:3300/0 conn(0x7f9e9c0cd680 msgr2=0x7f9e9c06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 --2- 172.21.15.114:0/687643401 >> v2:172.21.15.130:3300/0 conn(0x7f9e9c0cd680 0x7f9e9c06e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.975+0000 7f9e9a59c640 1 -- 172.21.15.114:0/687643401 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c0cdd20 con 0x7f9e9c1462f0 2024-04-13T02:46:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.976+0000 7f9e9a59c640 1 --2- 172.21.15.114:0/687643401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c072150 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c069d10 tx=0x7f9e8c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf8bf8429e98fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.976+0000 7f9e9959a640 1 -- 172.21.15.114:0/687643401 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c02cb00 con 0x7f9e9c1462f0 2024-04-13T02:46:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.976+0000 7f9e9959a640 1 -- 172.21.15.114:0/687643401 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c02cca0 con 0x7f9e9c1462f0 2024-04-13T02:46:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.976+0000 7f9e9959a640 1 -- 172.21.15.114:0/687643401 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c034610 con 0x7f9e9c1462f0 2024-04-13T02:46:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/687643401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c1462f0 msgr2=0x7f9e9c072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/687643401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c072150 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c069d10 tx=0x7f9e8c02bf60 comp rx=0 tx=0).stop 2024-04-13T02:46:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/687643401 shutdown_connections 2024-04-13T02:46:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/687643401 >> v2:172.21.15.130:3300/0 conn(0x7f9e9c0cd680 0x7f9e9c06e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/687643401 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c072690 0x7f9e9c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/687643401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c072150 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/687643401 >> 172.21.15.114:0/687643401 conn(0x7f9e9c0b2460 msgr2=0x7f9e9c0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/687643401 shutdown_connections 2024-04-13T02:46:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.977+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/687643401 wait complete. 2024-04-13T02:46:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.978+0000 7f9ea0d5e640 1 Processor -- start 2024-04-13T02:46:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.978+0000 7f9ea0d5e640 1 -- start start 2024-04-13T02:46:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9ea0d5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c072690 0x7f9e9c1f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9ea0d5e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c0cd680 0x7f9e9c1f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9ea0d5e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9ea0d5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c15d4d0 con 0x7f9e9c072690 2024-04-13T02:46:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9ea0d5e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c15d1f0 con 0x7f9e9c1462f0 2024-04-13T02:46:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9ea0d5e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9c06e6a0 con 0x7f9e9c0cd680 2024-04-13T02:46:16.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c072690 0x7f9e9c1f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c072690 0x7f9e9c1f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34458/0 (socket says 172.21.15.114:34458) 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 -- 172.21.15.114:0/3843709735 learned_addr learned my addr 172.21.15.114:0/3843709735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 -- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c0cd680 msgr2=0x7f9e9c1f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e99d9b640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c0cd680 0x7f9e9c1f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9ad9d640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e9c0cd680 0x7f9e9c1f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 -- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e9c1462f0 msgr2=0x7f9e9c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 -- 172.21.15.114:0/3843709735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c1f2fc0 con 0x7f9e9c072690 2024-04-13T02:46:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9ad9d640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e9c1462f0 0x7f9e9c144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.979+0000 7f9e9a59c640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c072690 0x7f9e9c1f2910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c036040 tx=0x7f9e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.980+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c043020 con 0x7f9e9c072690 2024-04-13T02:46:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.980+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c02ce50 con 0x7f9e9c072690 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.980+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c0c83d0 con 0x7f9e9c072690 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.980+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c009510 con 0x7f9e9c072690 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.980+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c142870 con 0x7f9e9c072690 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.980+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e9c068db0 con 0x7f9e9c072690 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.981+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e8c046020 con 0x7f9e9c072690 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e8affd640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9e7c06c920 0x7f9e7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f9e8c0ae3c0 con 0x7f9e9c072690 2024-04-13T02:46:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e99d9b640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9e7c06c920 0x7f9e7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e8affd640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f9e7c072880 0x7f9e7c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e7c075350 con 0x7f9e7c072880 2024-04-13T02:46:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c0ae850 con 0x7f9e9c072690 2024-04-13T02:46:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e9ad9d640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f9e7c072880 0x7f9e7c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e99d9b640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9e7c06c920 0x7f9e7c06ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c15f600 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.982+0000 7f9e9ad9d640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f9e7c072880 0x7f9e7c074ca0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.983+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== osd.3 v2:172.21.15.114:6807/1156508834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e7c075350 con 0x7f9e7c072880 2024-04-13T02:46:16.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 --> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e9c0cd120 con 0x7f9e7c072880 2024-04-13T02:46:16.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9e8affd640 1 -- 172.21.15.114:0/3843709735 <== osd.3 v2:172.21.15.114:6807/1156508834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e9c0cd120 con 0x7f9e7c072880 2024-04-13T02:46:16.997 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:16.997 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:16.997 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:16.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f9e7c072880 msgr2=0x7f9e7c074ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6807/1156508834,v1:172.21.15.114:6809/1156508834] conn(0x7f9e7c072880 0x7f9e7c074ca0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:16.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9e7c06c920 msgr2=0x7f9e7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f9e7c06c920 0x7f9e7c06ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c15f600 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c072690 msgr2=0x7f9e9c1f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 --2- 172.21.15.114:0/3843709735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c072690 0x7f9e9c1f2910 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c036040 tx=0x7f9e8c004a40 comp rx=0 tx=0).stop 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9e9ad9d640 1 -- 172.21.15.114:0/3843709735 reap_dead start 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 shutdown_connections 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 >> 172.21.15.114:0/3843709735 conn(0x7f9e9c0b2460 msgr2=0x7f9e9c15f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:16.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 shutdown_connections 2024-04-13T02:46:17.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:16.996+0000 7f9ea0d5e640 1 -- 172.21.15.114:0/3843709735 wait complete. 2024-04-13T02:46:17.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-13T02:46:17.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.109+0000 7f7350a60640 1 Processor -- start 2024-04-13T02:46:17.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.109+0000 7f7350a60640 1 -- start start 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7350a60640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f734c13f6a0 0x7f734c0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7350a60640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c06ef20 con 0x7f734c072100 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7350a60640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c072a20 con 0x7f734c0725b0 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7350a60640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f734c0a95b0 con 0x7f734c13f6a0 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f734a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f734c13f6a0 0x7f734c0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7343fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f734c072100 0x7f734c06e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53244/0 (socket says 172.21.15.114:53244) 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7343fff640 1 -- 172.21.15.114:0/1376843152 learned_addr learned my addr 172.21.15.114:0/1376843152 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f734a59c640 1 -- 172.21.15.114:0/1376843152 >> v1:172.21.15.130:6789/0 conn(0x7f734c0725b0 legacy=0x7f734c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f734a59c640 1 -- 172.21.15.114:0/1376843152 >> v1:172.21.15.114:6789/0 conn(0x7f734c072100 legacy=0x7f734c06e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f7349d9b640 1 -- 172.21.15.114:0/1376843152 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2813093245 0 0) 0x7f734c06ef20 con 0x7f734c072100 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.110+0000 7f734a59c640 1 -- 172.21.15.114:0/1376843152 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c15d200 con 0x7f734c13f6a0 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.111+0000 7f734a59c640 1 --2- 172.21.15.114:0/1376843152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c0ceda0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f733c0097a0 tx=0x7f733c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d1670a1443ab10 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.111+0000 7f7349d9b640 1 -- 172.21.15.114:0/1376843152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c035020 con 0x7f734c13f6a0 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.111+0000 7f7349d9b640 1 -- 172.21.15.114:0/1376843152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c031830 con 0x7f734c13f6a0 2024-04-13T02:46:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.111+0000 7f7349d9b640 1 -- 172.21.15.114:0/1376843152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c031c00 con 0x7f734c13f6a0 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 -- 172.21.15.114:0/1376843152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 msgr2=0x7f734c0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 --2- 172.21.15.114:0/1376843152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c0ceda0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f733c0097a0 tx=0x7f733c02b8d0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 -- 172.21.15.114:0/1376843152 shutdown_connections 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 --2- 172.21.15.114:0/1376843152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c0ceda0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 -- 172.21.15.114:0/1376843152 >> 172.21.15.114:0/1376843152 conn(0x7f734c0b2460 msgr2=0x7f734c0b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 -- 172.21.15.114:0/1376843152 shutdown_connections 2024-04-13T02:46:17.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.112+0000 7f7350a60640 1 -- 172.21.15.114:0/1376843152 wait complete. 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.113+0000 7f7350a60640 1 Processor -- start 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.113+0000 7f7350a60640 1 -- start start 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734c072100 0x7f734c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f734c0725b0 0x7f734c12e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f734c070400 con 0x7f734c13f6a0 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15daa0 con 0x7f734c0725b0 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f734c13fef0 con 0x7f734c072100 2024-04-13T02:46:17.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c15ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34484/0 (socket says 172.21.15.114:34484) 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 -- 172.21.15.114:0/4129464794 learned_addr learned my addr 172.21.15.114:0/4129464794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7343fff640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f734c0725b0 0x7f734c12e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 -- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734c072100 msgr2=0x7f734c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734a59c640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734c072100 0x7f734c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734c072100 0x7f734c0aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 -- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f734c0725b0 msgr2=0x7f734c12e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f734c0725b0 0x7f734c12e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 -- 172.21.15.114:0/4129464794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c1e5290 con 0x7f734c13f6a0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7343fff640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f734c0725b0 0x7f734c12e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f734ad9d640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c15ee60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f734400b9a0 tx=0x7f734400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344019070 con 0x7f734c13f6a0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734400cba0 con 0x7f734c13f6a0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c1e5570 con 0x7f734c13f6a0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344014440 con 0x7f734c13f6a0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.114+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c1e5b30 con 0x7f734c13f6a0 2024-04-13T02:46:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.115+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c068c80 con 0x7f734c13f6a0 2024-04-13T02:46:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.116+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f734401c070 con 0x7f734c13f6a0 2024-04-13T02:46:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.116+0000 7f7342ffd640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732c06c8f0 0x7f732c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.116+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f734408b540 con 0x7f734c13f6a0 2024-04-13T02:46:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.116+0000 7f734a59c640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732c06c8f0 0x7f732c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.116+0000 7f734a59c640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732c06c8f0 0x7f732c06edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f733c036000 tx=0x7f733c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.120+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7344059c10 con 0x7f734c13f6a0 2024-04-13T02:46:17.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.300+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f734c06d100 con 0x7f732c06c8f0 2024-04-13T02:46:17.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.300+0000 7f7342ffd640 1 -- 172.21.15.114:0/4129464794 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f734c06d100 con 0x7f732c06c8f0 2024-04-13T02:46:17.302 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 3 to deep-scrub 2024-04-13T02:46:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732c06c8f0 msgr2=0x7f732c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732c06c8f0 0x7f732c06edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f733c036000 tx=0x7f733c008030 comp rx=0 tx=0).stop 2024-04-13T02:46:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 msgr2=0x7f734c15ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c15ee60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f734400b9a0 tx=0x7f734400be60 comp rx=0 tx=0).stop 2024-04-13T02:46:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 shutdown_connections 2024-04-13T02:46:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734c13f6a0 0x7f734c15ee60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f734c0725b0 0x7f734c12e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f732c06c8f0 0x7f732c06edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 --2- 172.21.15.114:0/4129464794 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f734c072100 0x7f734c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 >> 172.21.15.114:0/4129464794 conn(0x7f734c0b2460 msgr2=0x7f734c06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 shutdown_connections 2024-04-13T02:46:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.302+0000 7f7350a60640 1 -- 172.21.15.114:0/4129464794 wait complete. 2024-04-13T02:46:17.314 INFO:tasks.ceph:Scrubbing osd.4 2024-04-13T02:46:17.314 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.419+0000 7f8ec09f0640 1 Processor -- start 2024-04-13T02:46:17.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.419+0000 7f8ec09f0640 1 -- start start 2024-04-13T02:46:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ec09f0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ebc06f980 0x7f8ebc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ec09f0640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ebc0cfc60 0x7f8ebc15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ec09f0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ebc160190 con 0x7f8ebc15fdb0 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ec09f0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8ebc072b90 con 0x7f8ebc06f980 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ec09f0640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8ebc073020 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb9d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ebc06f980 0x7f8ebc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eba59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ebc15fdb0 0x7f8ebc06f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53252/0 (socket says 172.21.15.114:53252) 2024-04-13T02:46:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eba59c640 1 -- 172.21.15.114:0/4173663341 learned_addr learned my addr 172.21.15.114:0/4173663341 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb959a640 1 -- 172.21.15.114:0/4173663341 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243251483 0 0) 0x7f8ebc160190 con 0x7f8ebc15fdb0 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb959a640 1 -- 172.21.15.114:0/4173663341 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ea8003520 con 0x7f8ebc15fdb0 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ebad9d640 1 --2- 172.21.15.114:0/4173663341 >> v2:172.21.15.130:3300/0 conn(0x7f8ebc0cfc60 0x7f8ebc15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/4173663341 >> v2:172.21.15.130:3300/0 conn(0x7f8ebc0cfc60 msgr2=0x7f8ebc15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb9d9b640 1 --2- 172.21.15.114:0/4173663341 >> v2:172.21.15.130:3300/0 conn(0x7f8ebc0cfc60 0x7f8ebc15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/4173663341 >> v1:172.21.15.114:6789/0 conn(0x7f8ebc15fdb0 legacy=0x7f8ebc06f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/4173663341 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc0d04e0 con 0x7f8ebc06f980 2024-04-13T02:46:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.420+0000 7f8ebad9d640 1 --2- 172.21.15.114:0/4173663341 >> v2:172.21.15.130:3300/0 conn(0x7f8ebc0cfc60 0x7f8ebc15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.421+0000 7f8eb9d9b640 1 --2- 172.21.15.114:0/4173663341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc06f980 0x7f8ebc0cf720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40097a0 tx=0x7f8ea402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325b97736cfa98d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.421+0000 7f8eb959a640 1 -- 172.21.15.114:0/4173663341 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4035020 con 0x7f8ebc06f980 2024-04-13T02:46:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.421+0000 7f8eb959a640 1 -- 172.21.15.114:0/4173663341 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4031830 con 0x7f8ebc06f980 2024-04-13T02:46:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.421+0000 7f8eb959a640 1 -- 172.21.15.114:0/4173663341 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4031c00 con 0x7f8ebc06f980 2024-04-13T02:46:17.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.421+0000 7f8ec09f0640 1 -- 172.21.15.114:0/4173663341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc06f980 msgr2=0x7f8ebc0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.421+0000 7f8ec09f0640 1 --2- 172.21.15.114:0/4173663341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc06f980 0x7f8ebc0cf720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40097a0 tx=0x7f8ea402b8d0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.422+0000 7f8ec09f0640 1 -- 172.21.15.114:0/4173663341 shutdown_connections 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.422+0000 7f8ec09f0640 1 --2- 172.21.15.114:0/4173663341 >> v2:172.21.15.130:3300/0 conn(0x7f8ebc0cfc60 0x7f8ebc15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.422+0000 7f8ec09f0640 1 --2- 172.21.15.114:0/4173663341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc06f980 0x7f8ebc0cf720 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.422+0000 7f8ec09f0640 1 -- 172.21.15.114:0/4173663341 >> 172.21.15.114:0/4173663341 conn(0x7f8ebc0b2460 msgr2=0x7f8ebc0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.422+0000 7f8ec09f0640 1 -- 172.21.15.114:0/4173663341 shutdown_connections 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.422+0000 7f8ec09f0640 1 -- 172.21.15.114:0/4173663341 wait complete. 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.423+0000 7f8ec09f0640 1 Processor -- start 2024-04-13T02:46:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.423+0000 7f8ec09f0640 1 -- start start 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ebc06f980 0x7f8ebc14e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0cfc60 0x7f8ebc1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ebc15fdb0 0x7f8ebc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc072540 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc072260 con 0x7f8ebc15fdb0 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ebc072820 con 0x7f8ebc06f980 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0cfc60 0x7f8ebc1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0cfc60 0x7f8ebc1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34502/0 (socket says 172.21.15.114:34502) 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/998711445 learned_addr learned my addr 172.21.15.114:0/998711445 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ebad9d640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ebc15fdb0 0x7f8ebc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eba59c640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ebc06f980 0x7f8ebc14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ebc06f980 msgr2=0x7f8ebc14e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ebc06f980 0x7f8ebc14e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ebc15fdb0 msgr2=0x7f8ebc1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ebc15fdb0 0x7f8ebc1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 -- 172.21.15.114:0/998711445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc14f1e0 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eba59c640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ebc06f980 0x7f8ebc14e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb9d9b640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0cfc60 0x7f8ebc1550b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8ea402bee0 tx=0x7f8ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4035040 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea403b920 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc14f4c0 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea403bd10 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.424+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc14fa80 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.425+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ebc068db0 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ea4038020 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eb2ffd640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e9c06c8f0 0x7f8e9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f8ea40ad930 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eba59c640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e9c06c8f0 0x7f8e9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eb2ffd640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7f8e9c072850 0x7f8e9c074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 --> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e9c075320 con 0x7f8e9c072850 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8ea40b22c0 con 0x7f8ebc0cfc60 2024-04-13T02:46:17.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8ebad9d640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7f8e9c072850 0x7f8e9c074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.426+0000 7f8eba59c640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e9c06c8f0 0x7f8e9c06edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8eac007fd0 tx=0x7f8eac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.427+0000 7f8ebad9d640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7f8e9c072850 0x7f8e9c074c70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.428+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== osd.4 v2:172.21.15.130:6800/3673343722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e9c075320 con 0x7f8e9c072850 2024-04-13T02:46:17.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.441+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 --> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8ebc0b3880 con 0x7f8e9c072850 2024-04-13T02:46:17.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.441+0000 7f8eb2ffd640 1 -- 172.21.15.114:0/998711445 <== osd.4 v2:172.21.15.130:6800/3673343722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8ebc0b3880 con 0x7f8e9c072850 2024-04-13T02:46:17.442 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:17.442 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:17.442 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:17.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7f8e9c072850 msgr2=0x7f8e9c074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.130:6800/3673343722,v1:172.21.15.130:6801/3673343722] conn(0x7f8e9c072850 0x7f8e9c074c70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e9c06c8f0 msgr2=0x7f8e9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8e9c06c8f0 0x7f8e9c06edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8eac007fd0 tx=0x7f8eac009040 comp rx=0 tx=0).stop 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0cfc60 msgr2=0x7f8ebc1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 --2- 172.21.15.114:0/998711445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0cfc60 0x7f8ebc1550b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8ea402bee0 tx=0x7f8ea40046c0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ebad9d640 1 -- 172.21.15.114:0/998711445 reap_dead start 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 shutdown_connections 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 >> 172.21.15.114:0/998711445 conn(0x7f8ebc0b2460 msgr2=0x7f8ebc0afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 shutdown_connections 2024-04-13T02:46:17.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.442+0000 7f8ec09f0640 1 -- 172.21.15.114:0/998711445 wait complete. 2024-04-13T02:46:17.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-13T02:46:17.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 Processor -- start 2024-04-13T02:46:17.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 -- start start 2024-04-13T02:46:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c160900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb2c15dc00 0x7fdb2c09ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb2c160e40 con 0x7fdb2c0cd1b0 2024-04-13T02:46:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2c0ce2a0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.554+0000 7fdb31fbb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c0cd690 con 0x7fdb2c160520 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb2c15dc00 0x7fdb2c09ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb2c15dc00 0x7fdb2c09ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34514/0 (socket says 172.21.15.114:34514) 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 -- 172.21.15.114:0/2996275350 learned_addr learned my addr 172.21.15.114:0/2996275350 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2b7fe640 1 --2- 172.21.15.114:0/2996275350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 -- 172.21.15.114:0/2996275350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 msgr2=0x7fdb2c160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 --2- 172.21.15.114:0/2996275350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 -- 172.21.15.114:0/2996275350 >> v1:172.21.15.130:6789/0 conn(0x7fdb2c0cd1b0 legacy=0x7fdb2c0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.555+0000 7fdb2bfff640 1 -- 172.21.15.114:0/2996275350 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0cd970 con 0x7fdb2c15dc00 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb2bfff640 1 --2- 172.21.15.114:0/2996275350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c09ab20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009e50 tx=0x7fdb2402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a89fe3008faa20 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb2a7fc640 1 -- 172.21.15.114:0/2996275350 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2402cb00 con 0x7fdb2c15dc00 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb2a7fc640 1 -- 172.21.15.114:0/2996275350 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2402cca0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb2a7fc640 1 -- 172.21.15.114:0/2996275350 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24034610 con 0x7fdb2c15dc00 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 -- 172.21.15.114:0/2996275350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 msgr2=0x7fdb2c09ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/2996275350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c09ab20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009e50 tx=0x7fdb2402bf60 comp rx=0 tx=0).stop 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 -- 172.21.15.114:0/2996275350 shutdown_connections 2024-04-13T02:46:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/2996275350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c09ab20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/2996275350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 -- 172.21.15.114:0/2996275350 >> 172.21.15.114:0/2996275350 conn(0x7fdb2c0d2740 msgr2=0x7fdb2c0d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 -- 172.21.15.114:0/2996275350 shutdown_connections 2024-04-13T02:46:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.556+0000 7fdb31fbb640 1 -- 172.21.15.114:0/2996275350 wait complete. 2024-04-13T02:46:17.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.557+0000 7fdb31fbb640 1 Processor -- start 2024-04-13T02:46:17.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 -- start start 2024-04-13T02:46:17.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb2c0cd1b0 0x7fdb2c1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c1f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c1f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d14a0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0cdf30 con 0x7fdb2c0cd1b0 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb31fbb640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c0d1620 con 0x7fdb2c160520 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb2affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c1f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb2affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c1f6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34516/0 (socket says 172.21.15.114:34516) 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb2affd640 1 -- 172.21.15.114:0/283684305 learned_addr learned my addr 172.21.15.114:0/283684305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb2b7fe640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb2c0cd1b0 0x7fdb2c1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.558+0000 7fdb2bfff640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c1f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb2affd640 1 -- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 msgr2=0x7fdb2c1f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb2affd640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c1f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb2affd640 1 -- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb2c0cd1b0 msgr2=0x7fdb2c1f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb2affd640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb2c0cd1b0 0x7fdb2c1f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb2affd640 1 -- 172.21.15.114:0/283684305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c1f7340 con 0x7fdb2c15dc00 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb2affd640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c1f6e00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c3c0 tx=0x7fdb2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb200052d0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20005490 con 0x7fdb2c15dc00 2024-04-13T02:46:17.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c0c9c50 con 0x7fdb2c15dc00 2024-04-13T02:46:17.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20007260 con 0x7fdb2c15dc00 2024-04-13T02:46:17.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.559+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c1f34d0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.560+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c1f36d0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.561+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb20007400 con 0x7fdb2c15dc00 2024-04-13T02:46:17.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.561+0000 7fdb13fff640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb1806c920 0x7fdb1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.561+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fdb2008ac80 con 0x7fdb2c15dc00 2024-04-13T02:46:17.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.561+0000 7fdb2b7fe640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb1806c920 0x7fdb1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.561+0000 7fdb2b7fe640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb1806c920 0x7fdb1806ede0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c006fd0 tx=0x7fdb1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.565+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb2c1f36d0 con 0x7fdb2c15dc00 2024-04-13T02:46:17.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.740+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fdb2c15fa80 con 0x7fdb1806c920 2024-04-13T02:46:17.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.741+0000 7fdb13fff640 1 -- 172.21.15.114:0/283684305 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdb2c15fa80 con 0x7fdb1806c920 2024-04-13T02:46:17.742 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 4 to deep-scrub 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb1806c920 msgr2=0x7fdb1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb1806c920 0x7fdb1806ede0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c006fd0 tx=0x7fdb1c008040 comp rx=0 tx=0).stop 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 msgr2=0x7fdb2c1f6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c1f6e00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c3c0 tx=0x7fdb2000c880 comp rx=0 tx=0).stop 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 shutdown_connections 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fdb1806c920 0x7fdb1806ede0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdb2c160520 0x7fdb2c1f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb2c15dc00 0x7fdb2c1f6e00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 --2- 172.21.15.114:0/283684305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb2c0cd1b0 0x7fdb2c1f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 >> 172.21.15.114:0/283684305 conn(0x7fdb2c0d2740 msgr2=0x7fdb2c15b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 shutdown_connections 2024-04-13T02:46:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.743+0000 7fdb31fbb640 1 -- 172.21.15.114:0/283684305 wait complete. 2024-04-13T02:46:17.754 INFO:tasks.ceph:Scrubbing osd.5 2024-04-13T02:46:17.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:17.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.858+0000 7fe234298640 1 Processor -- start 2024-04-13T02:46:17.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.858+0000 7fe234298640 1 -- start start 2024-04-13T02:46:17.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe234298640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe22c15fdb0 0x7fe22c06f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe234298640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe234298640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22c160190 con 0x7fe22c0cfc60 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe234298640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe22c072b90 con 0x7fe22c15fdb0 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe234298640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c073020 con 0x7fe22c06f7b0 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe231833640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe232034640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe22c15fdb0 0x7fe22c06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe231833640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:49434/0 (socket says 172.21.15.114:49434) 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe232835640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe22c0cfc60 0x7fe22c0b3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:33616/0 (socket says 172.21.15.114:33616) 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.859+0000 7fe231833640 1 -- 172.21.15.114:0/381157661 learned_addr learned my addr 172.21.15.114:0/381157661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.860+0000 7fe231833640 1 -- 172.21.15.114:0/381157661 >> v2:172.21.15.130:3300/0 conn(0x7fe22c15fdb0 msgr2=0x7fe22c06f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.860+0000 7fe231833640 1 --2- 172.21.15.114:0/381157661 >> v2:172.21.15.130:3300/0 conn(0x7fe22c15fdb0 0x7fe22c06f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.860+0000 7fe231833640 1 -- 172.21.15.114:0/381157661 >> v1:172.21.15.130:6789/0 conn(0x7fe22c0cfc60 legacy=0x7fe22c0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.860+0000 7fe231833640 1 -- 172.21.15.114:0/381157661 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c0d04e0 con 0x7fe22c06f7b0 2024-04-13T02:46:17.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe231833640 1 --2- 172.21.15.114:0/381157661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c0cf720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00bb10 tx=0x7fe21c02e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e571824ae87f8685 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe231032640 1 -- 172.21.15.114:0/381157661 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c03b070 con 0x7fe22c06f7b0 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe231032640 1 -- 172.21.15.114:0/381157661 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c036440 con 0x7fe22c06f7b0 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe231032640 1 -- 172.21.15.114:0/381157661 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c036810 con 0x7fe22c06f7b0 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 -- 172.21.15.114:0/381157661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 msgr2=0x7fe22c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 --2- 172.21.15.114:0/381157661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c0cf720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00bb10 tx=0x7fe21c02e150 comp rx=0 tx=0).stop 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 -- 172.21.15.114:0/381157661 shutdown_connections 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 --2- 172.21.15.114:0/381157661 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c0cf720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 --2- 172.21.15.114:0/381157661 >> v2:172.21.15.130:3300/0 conn(0x7fe22c15fdb0 0x7fe22c06f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 -- 172.21.15.114:0/381157661 >> 172.21.15.114:0/381157661 conn(0x7fe22c0b2460 msgr2=0x7fe22c0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 -- 172.21.15.114:0/381157661 shutdown_connections 2024-04-13T02:46:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.861+0000 7fe234298640 1 -- 172.21.15.114:0/381157661 wait complete. 2024-04-13T02:46:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 Processor -- start 2024-04-13T02:46:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 -- start start 2024-04-13T02:46:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0cfc60 0x7fe22c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c15fdb0 0x7fe22c0ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c072260 con 0x7fe22c15fdb0 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c15cbd0 con 0x7fe22c0cfc60 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.863+0000 7fe234298640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c072540 con 0x7fe22c06f7b0 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c15fdb0 0x7fe22c0ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c15fdb0 0x7fe22c0ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34526/0 (socket says 172.21.15.114:34526) 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 -- 172.21.15.114:0/1580117637 learned_addr learned my addr 172.21.15.114:0/1580117637 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe231833640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0cfc60 0x7fe22c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232034640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 -- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 msgr2=0x7fe22c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe22c06f7b0 0x7fe22c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 -- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0cfc60 msgr2=0x7fe22c0ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe22c0cfc60 0x7fe22c0ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 -- 172.21.15.114:0/1580117637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c148ef0 con 0x7fe22c15fdb0 2024-04-13T02:46:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe232835640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c15fdb0 0x7fe22c0ae650 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c400 tx=0x7fe22400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240074e0 con 0x7fe22c15fdb0 2024-04-13T02:46:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe224007680 con 0x7fe22c15fdb0 2024-04-13T02:46:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c1491d0 con 0x7fe22c15fdb0 2024-04-13T02:46:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240049e0 con 0x7fe22c15fdb0 2024-04-13T02:46:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.864+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c149790 con 0x7fe22c15fdb0 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.865+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe22c068db0 con 0x7fe22c15fdb0 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe22401a020 con 0x7fe22c15fdb0 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe222ffd640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe21006c8f0 0x7fe21006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fe22408b940 con 0x7fe22c15fdb0 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe232034640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe21006c8f0 0x7fe21006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe222ffd640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fe210072850 0x7fe210074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 --> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe22400ee50 con 0x7fe210072850 2024-04-13T02:46:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.866+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe22408bdd0 con 0x7fe22c15fdb0 2024-04-13T02:46:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.867+0000 7fe231833640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fe210072850 0x7fe210074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.867+0000 7fe232034640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe21006c8f0 0x7fe21006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe228011340 tx=0x7fe22800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.867+0000 7fe231833640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fe210072850 0x7fe210074c70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.868+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== osd.5 v2:172.21.15.130:6802/2468914972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe22400ee50 con 0x7fe210072850 2024-04-13T02:46:17.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.880+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 --> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe22c0b3880 con 0x7fe210072850 2024-04-13T02:46:17.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.881+0000 7fe222ffd640 1 -- 172.21.15.114:0/1580117637 <== osd.5 v2:172.21.15.130:6802/2468914972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe22c0b3880 con 0x7fe210072850 2024-04-13T02:46:17.882 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:17.882 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:17.882 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:17.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fe210072850 msgr2=0x7fe210074c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.130:6802/2468914972,v1:172.21.15.130:6804/2468914972] conn(0x7fe210072850 0x7fe210074c70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe21006c8f0 msgr2=0x7fe21006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fe21006c8f0 0x7fe21006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe228011340 tx=0x7fe22800b040 comp rx=0 tx=0).stop 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c15fdb0 msgr2=0x7fe22c0ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 --2- 172.21.15.114:0/1580117637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe22c15fdb0 0x7fe22c0ae650 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c400 tx=0x7fe22400c8c0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe232835640 1 -- 172.21.15.114:0/1580117637 reap_dead start 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 shutdown_connections 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 >> 172.21.15.114:0/1580117637 conn(0x7fe22c0b2460 msgr2=0x7fe22c0b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 shutdown_connections 2024-04-13T02:46:17.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.882+0000 7fe234298640 1 -- 172.21.15.114:0/1580117637 wait complete. 2024-04-13T02:46:17.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-13T02:46:17.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.994+0000 7f32a4e88640 1 Processor -- start 2024-04-13T02:46:17.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.994+0000 7f32a4e88640 1 -- start start 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.994+0000 7f32a4e88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f32a00d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.994+0000 7f32a4e88640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a00d32c0 con 0x7f32a00d1300 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.994+0000 7f32a4e88640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a00d35a0 con 0x7f32a00d2c30 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.994+0000 7f32a4e88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f32a00d3090 con 0x7f32a015ec40 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f32a00d1300 0x7f32a00b78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53262/0 (socket says 172.21.15.114:53262) 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329ed9d640 1 -- 172.21.15.114:0/1408245819 learned_addr learned my addr 172.21.15.114:0/1408245819 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329e59c640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f32a00d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079859351 0 0) 0x7f32a00d32c0 con 0x7f32a00d1300 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f328c003520 con 0x7f32a00d1300 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1122519726 0 0) 0x7f328c003520 con 0x7f32a00d1300 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 msgr2=0x7f32a00d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f32a00d4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 >> v1:172.21.15.130:6789/0 conn(0x7f32a00d2c30 legacy=0x7f32a00ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a00d3880 con 0x7f32a00d1300 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f32980019f0 con 0x7f32a00d1300 2024-04-13T02:46:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 >> v1:172.21.15.114:6789/0 conn(0x7f32a00d1300 legacy=0x7f32a00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f328c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f328c003f20 0x7f328c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c004d40 0x7f328c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f328c00b9f0 con 0x7f328c003f20 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f328c00bba0 con 0x7f328c004d40 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f328c00bda0 con 0x7f32a015ec40 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f3297fff640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f328c003f20 0x7f328c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329ed9d640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c004d40 0x7f328c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329e59c640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f328c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f3297fff640 1 -- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 msgr2=0x7f328c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f3297fff640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f328c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f3297fff640 1 -- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c004d40 msgr2=0x7f328c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f3297fff640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c004d40 0x7f328c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f3297fff640 1 -- 172.21.15.114:0/1408245819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c003520 con 0x7f328c003f20 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.995+0000 7f329e59c640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a015ec40 0x7f328c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.996+0000 7f3297fff640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f328c003f20 0x7f328c004800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3288001830 tx=0x7f328c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65089d6e9d4abf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.996+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288001430 con 0x7f328c003f20 2024-04-13T02:46:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.996+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288032620 con 0x7f328c003f20 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.996+0000 7f329dd9b640 1 -- 172.21.15.114:0/1408245819 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288032a10 con 0x7f328c003f20 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f32a4e88640 1 -- 172.21.15.114:0/1408245819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f328c003f20 msgr2=0x7f328c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f32a4e88640 1 --2- 172.21.15.114:0/1408245819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f328c003f20 0x7f328c004800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3288001830 tx=0x7f328c005830 comp rx=0 tx=0).stop 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f329ed9d640 1 -- 172.21.15.114:0/1408245819 reap_dead start 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f32a4e88640 1 -- 172.21.15.114:0/1408245819 shutdown_connections 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f32a4e88640 1 -- 172.21.15.114:0/1408245819 >> 172.21.15.114:0/1408245819 conn(0x7f32a0073690 msgr2=0x7f32a006cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f32a4e88640 1 -- 172.21.15.114:0/1408245819 shutdown_connections 2024-04-13T02:46:18.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.997+0000 7f32a4e88640 1 -- 172.21.15.114:0/1408245819 wait complete. 2024-04-13T02:46:18.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.998+0000 7f32a4e88640 1 Processor -- start 2024-04-13T02:46:18.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.998+0000 7f32a4e88640 1 -- start start 2024-04-13T02:46:18.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f32a4e88640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c003f20 0x7f32a0161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f32a4e88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 0x7f32a00b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f32a4e88640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a01f4f20 0x7f32a00b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f32a4e88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32a00d4360 con 0x7f32a01f4aa0 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f32a4e88640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32a00d3e40 con 0x7f328c003f20 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f32a4e88640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f32a00d44e0 con 0x7f32a01f4f20 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 0x7f32a00b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 0x7f32a00b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34542/0 (socket says 172.21.15.114:34542) 2024-04-13T02:46:18.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 -- 172.21.15.114:0/561935294 learned_addr learned my addr 172.21.15.114:0/561935294 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f329ed9d640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a01f4f20 0x7f32a00b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f329e59c640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c003f20 0x7f32a0161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 -- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a01f4f20 msgr2=0x7f32a00b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a01f4f20 0x7f32a00b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 -- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c003f20 msgr2=0x7f32a0161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c003f20 0x7f32a0161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f3297fff640 1 -- 172.21.15.114:0/561935294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a00b99d0 con 0x7f32a01f4aa0 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f329ed9d640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a01f4f20 0x7f32a00b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:17.999+0000 7f329e59c640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c003f20 0x7f32a0161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.000+0000 7f3297fff640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 0x7f32a00b7860 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3288001890 tx=0x7f3288001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.000+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32880035f0 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.000+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288003790 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.000+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a00b9c40 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.000+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288003b40 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.000+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a00ba200 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.001+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a00c7c10 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.001+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3288003ce0 con 0x7f32a01f4aa0 2024-04-13T02:46:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.001+0000 7f3296ffd640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f328006c920 0x7f328006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.002+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f32880ad970 con 0x7f32a01f4aa0 2024-04-13T02:46:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.002+0000 7f329e59c640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f328006c920 0x7f328006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.002+0000 7f329e59c640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f328006c920 0x7f328006ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f32a015f4e0 tx=0x7f3290008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.006+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f32a00c7c10 con 0x7f32a01f4aa0 2024-04-13T02:46:18.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.181+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f32a0068c80 con 0x7f328006c920 2024-04-13T02:46:18.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.181+0000 7f3296ffd640 1 -- 172.21.15.114:0/561935294 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f32a0068c80 con 0x7f328006c920 2024-04-13T02:46:18.182 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 5 to deep-scrub 2024-04-13T02:46:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f328006c920 msgr2=0x7f328006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f328006c920 0x7f328006ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f32a015f4e0 tx=0x7f3290008040 comp rx=0 tx=0).stop 2024-04-13T02:46:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 msgr2=0x7f32a00b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 0x7f32a00b7860 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3288001890 tx=0x7f3288001230 comp rx=0 tx=0).stop 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 shutdown_connections 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f328006c920 0x7f328006ede0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32a01f4f20 0x7f32a00b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a01f4aa0 0x7f32a00b7860 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 --2- 172.21.15.114:0/561935294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f328c003f20 0x7f32a0161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 >> 172.21.15.114:0/561935294 conn(0x7f32a0073690 msgr2=0x7f32a015cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 shutdown_connections 2024-04-13T02:46:18.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.183+0000 7f32a4e88640 1 -- 172.21.15.114:0/561935294 wait complete. 2024-04-13T02:46:18.194 INFO:tasks.ceph:Scrubbing osd.6 2024-04-13T02:46:18.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:18.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.298+0000 7fac478ad640 1 Processor -- start 2024-04-13T02:46:18.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.298+0000 7fac478ad640 1 -- start start 2024-04-13T02:46:18.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac478ad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac400cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac478ad640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac40160190 con 0x7fac4015fdb0 2024-04-13T02:46:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac478ad640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac400d04e0 con 0x7fac400cfc60 2024-04-13T02:46:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac478ad640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac40072b90 con 0x7fac4006f980 2024-04-13T02:46:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac45649640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fac4015fdb0 0x7fac4006f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53272/0 (socket says 172.21.15.114:53272) 2024-04-13T02:46:18.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac45649640 1 -- 172.21.15.114:0/1099449503 learned_addr learned my addr 172.21.15.114:0/1099449503 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac44e48640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac400cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147382038 0 0) 0x7fac40160190 con 0x7fac4015fdb0 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.299+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac2c003520 con 0x7fac4015fdb0 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920455795 0 0) 0x7fac400d04e0 con 0x7fac400cfc60 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac40160190 con 0x7fac400cfc60 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2253383858 0 0) 0x7fac2c003520 con 0x7fac4015fdb0 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 msgr2=0x7fac400cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac400cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 >> v1:172.21.15.130:6789/0 conn(0x7fac400cfc60 legacy=0x7fac4015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac40073020 con 0x7fac4015fdb0 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7fac3c0019f0 con 0x7fac4015fdb0 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac44e48640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac400cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 >> v1:172.21.15.114:6789/0 conn(0x7fac4015fdb0 legacy=0x7fac4006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac2c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c0040b0 0x7fac2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac2c004d40 0x7fac2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac40072b90 con 0x7fac2c004d40 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c00dc80 con 0x7fac2c0040b0 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c00de80 con 0x7fac4006f980 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45e4a640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac2c004d40 0x7fac2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45649640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac2c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac44e48640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c0040b0 0x7fac2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45e4a640 1 -- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 msgr2=0x7fac2c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45e4a640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac4006f980 0x7fac2c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45e4a640 1 -- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c0040b0 msgr2=0x7fac2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45e4a640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c0040b0 0x7fac2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.300+0000 7fac45e4a640 1 -- 172.21.15.114:0/1099449503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c003520 con 0x7fac2c004d40 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac45e4a640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac2c004d40 0x7fac2c0051c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fac380018d0 tx=0x7fac2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869eede63dafcc1d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38037070 con 0x7fac2c004d40 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac380052d0 con 0x7fac2c004d40 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac37fff640 1 -- 172.21.15.114:0/1099449503 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac380014f0 con 0x7fac2c004d40 2024-04-13T02:46:18.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac478ad640 1 -- 172.21.15.114:0/1099449503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac2c004d40 msgr2=0x7fac2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac478ad640 1 --2- 172.21.15.114:0/1099449503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac2c004d40 0x7fac2c0051c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fac380018d0 tx=0x7fac2c005830 comp rx=0 tx=0).stop 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.301+0000 7fac45e4a640 1 -- 172.21.15.114:0/1099449503 reap_dead start 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.302+0000 7fac478ad640 1 -- 172.21.15.114:0/1099449503 shutdown_connections 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.302+0000 7fac478ad640 1 -- 172.21.15.114:0/1099449503 >> 172.21.15.114:0/1099449503 conn(0x7fac400b2460 msgr2=0x7fac400b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.302+0000 7fac478ad640 1 -- 172.21.15.114:0/1099449503 shutdown_connections 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.302+0000 7fac478ad640 1 -- 172.21.15.114:0/1099449503 wait complete. 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 Processor -- start 2024-04-13T02:46:18.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 -- start start 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c004d40 0x7fac400add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac40154430 0x7fac400cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac400cb1f0 0x7fac400ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac40072540 con 0x7fac400cb1f0 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.303+0000 7fac478ad640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac40072260 con 0x7fac2c004d40 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac478ad640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fac40072820 con 0x7fac40154430 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac400cb1f0 0x7fac400ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac400cb1f0 0x7fac400ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34550/0 (socket says 172.21.15.114:34550) 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 -- 172.21.15.114:0/2568130234 learned_addr learned my addr 172.21.15.114:0/2568130234 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45649640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c004d40 0x7fac400add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac44e48640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac40154430 0x7fac400cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 -- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac40154430 msgr2=0x7fac400cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fac40154430 0x7fac400cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 -- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c004d40 msgr2=0x7fac400add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac2c004d40 0x7fac400add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 -- 172.21.15.114:0/2568130234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac400c9c10 con 0x7fac400cb1f0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac45e4a640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac400cb1f0 0x7fac400ab670 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fac380019f0 tx=0x7fac380012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38045070 con 0x7fac400cb1f0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38038040 con 0x7fac400cb1f0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac400c9ef0 con 0x7fac400cb1f0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38037070 con 0x7fac400cb1f0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.304+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac400ca4b0 con 0x7fac400cb1f0 2024-04-13T02:46:18.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.305+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac40068db0 con 0x7fac400cb1f0 2024-04-13T02:46:18.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac38048070 con 0x7fac400cb1f0 2024-04-13T02:46:18.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac35ffb640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac2406c920 0x7fac2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fac380ac650 con 0x7fac400cb1f0 2024-04-13T02:46:18.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac45649640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac2406c920 0x7fac2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac35ffb640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fac24072880 0x7fac24074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 --> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac3803ce50 con 0x7fac24072880 2024-04-13T02:46:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.306+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fac380b3050 con 0x7fac400cb1f0 2024-04-13T02:46:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.307+0000 7fac44e48640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fac24072880 0x7fac24074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.307+0000 7fac45649640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac2406c920 0x7fac2406ede0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fac3c001fe0 tx=0x7fac3c006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.307+0000 7fac44e48640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fac24072880 0x7fac24074ca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.308+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== osd.6 v2:172.21.15.130:6816/576238142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac3803ce50 con 0x7fac24072880 2024-04-13T02:46:18.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.321+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 --> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fac400b2210 con 0x7fac24072880 2024-04-13T02:46:18.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.321+0000 7fac35ffb640 1 -- 172.21.15.114:0/2568130234 <== osd.6 v2:172.21.15.130:6816/576238142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fac400b2210 con 0x7fac24072880 2024-04-13T02:46:18.322 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:18.322 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:18.323 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fac24072880 msgr2=0x7fac24074ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.130:6816/576238142,v1:172.21.15.130:6817/576238142] conn(0x7fac24072880 0x7fac24074ca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac2406c920 msgr2=0x7fac2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fac2406c920 0x7fac2406ede0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fac3c001fe0 tx=0x7fac3c006040 comp rx=0 tx=0).stop 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac400cb1f0 msgr2=0x7fac400ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 --2- 172.21.15.114:0/2568130234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac400cb1f0 0x7fac400ab670 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fac380019f0 tx=0x7fac380012d0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac45e4a640 1 -- 172.21.15.114:0/2568130234 reap_dead start 2024-04-13T02:46:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 shutdown_connections 2024-04-13T02:46:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 >> 172.21.15.114:0/2568130234 conn(0x7fac400b2460 msgr2=0x7fac400b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 shutdown_connections 2024-04-13T02:46:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.322+0000 7fac478ad640 1 -- 172.21.15.114:0/2568130234 wait complete. 2024-04-13T02:46:18.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-13T02:46:18.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.433+0000 7f54b2915640 1 Processor -- start 2024-04-13T02:46:18.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.433+0000 7f54b2915640 1 -- start start 2024-04-13T02:46:18.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b2915640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54ac0b5790 0x7f54ac0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b2915640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac1625d0 0x7f54ac0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b2915640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f54ac0b60b0 0x7f54ac0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b2915640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac0b3d00 con 0x7f54ac0b60b0 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b2915640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac15efe0 con 0x7f54ac0b5790 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b2915640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac15f2a0 con 0x7f54ac1625d0 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f54ac0b60b0 0x7f54ac0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f54ac0b60b0 0x7f54ac0b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34566/0 (socket says 172.21.15.114:34566) 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 -- 172.21.15.114:0/1216509204 learned_addr learned my addr 172.21.15.114:0/1216509204 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54abfff640 1 --2- 172.21.15.114:0/1216509204 >> v2:172.21.15.130:3300/0 conn(0x7f54ac0b5790 0x7f54ac0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54ab7fe640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac1625d0 0x7f54ac0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 -- 172.21.15.114:0/1216509204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac1625d0 msgr2=0x7f54ac0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac1625d0 0x7f54ac0b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 -- 172.21.15.114:0/1216509204 >> v2:172.21.15.130:3300/0 conn(0x7f54ac0b5790 msgr2=0x7f54ac0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 --2- 172.21.15.114:0/1216509204 >> v2:172.21.15.130:3300/0 conn(0x7f54ac0b5790 0x7f54ac0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54b0eb2640 1 -- 172.21.15.114:0/1216509204 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac15f580 con 0x7f54ac0b60b0 2024-04-13T02:46:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54abfff640 1 --2- 172.21.15.114:0/1216509204 >> v2:172.21.15.130:3300/0 conn(0x7f54ac0b5790 0x7f54ac0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.434+0000 7f54ab7fe640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac1625d0 0x7f54ac0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54b0eb2640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0b4660 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f54ac068be0 tx=0x7f54a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620b8f21c19730ff server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54aaffd640 1 -- 172.21.15.114:0/1216509204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a402ca70 con 0x7f54ac0b60b0 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54aaffd640 1 -- 172.21.15.114:0/1216509204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a402cc10 con 0x7f54ac0b60b0 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54aaffd640 1 -- 172.21.15.114:0/1216509204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a40343f0 con 0x7f54ac0b60b0 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54b2915640 1 -- 172.21.15.114:0/1216509204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 msgr2=0x7f54ac0b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54b2915640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0b4660 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f54ac068be0 tx=0x7f54a402bed0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.435+0000 7f54b2915640 1 -- 172.21.15.114:0/1216509204 shutdown_connections 2024-04-13T02:46:18.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.436+0000 7f54b2915640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0b4660 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.436+0000 7f54b2915640 1 --2- 172.21.15.114:0/1216509204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac1625d0 0x7f54ac0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.436+0000 7f54b2915640 1 --2- 172.21.15.114:0/1216509204 >> v2:172.21.15.130:3300/0 conn(0x7f54ac0b5790 0x7f54ac0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.436+0000 7f54b2915640 1 -- 172.21.15.114:0/1216509204 >> 172.21.15.114:0/1216509204 conn(0x7f54ac06eb10 msgr2=0x7f54ac06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.436+0000 7f54b2915640 1 -- 172.21.15.114:0/1216509204 shutdown_connections 2024-04-13T02:46:18.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.436+0000 7f54b2915640 1 -- 172.21.15.114:0/1216509204 wait complete. 2024-04-13T02:46:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.437+0000 7f54b2915640 1 Processor -- start 2024-04-13T02:46:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.437+0000 7f54b2915640 1 -- start start 2024-04-13T02:46:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.437+0000 7f54b2915640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac0b5790 0x7f54ac147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ac0b0030 0x7f54ac1f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac15c850 con 0x7f54ac0b60b0 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac15fb40 con 0x7f54ac0b0030 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac15c9d0 con 0x7f54ac0b5790 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34570/0 (socket says 172.21.15.114:34570) 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 -- 172.21.15.114:0/1139095680 learned_addr learned my addr 172.21.15.114:0/1139095680 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b0eb2640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ac0b0030 0x7f54ac1f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54abfff640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac0b5790 0x7f54ac147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 -- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac0b5790 msgr2=0x7f54ac147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac0b5790 0x7f54ac147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 -- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ac0b0030 msgr2=0x7f54ac1f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ac0b0030 0x7f54ac1f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 -- 172.21.15.114:0/1139095680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac14aa30 con 0x7f54ac0b60b0 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54abfff640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac0b5790 0x7f54ac147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b0eb2640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ac0b0030 0x7f54ac1f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54ab7fe640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0afaf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e7e0 tx=0x7f549c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c00f040 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c004030 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac14ad10 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c004400 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.438+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac14b2d0 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.439+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac068c80 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.440+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f549c00c6d0 con 0x7f54ac0b60b0 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.440+0000 7f54a8ff9640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f549806c8f0 0x7f549806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.440+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f549c08b640 con 0x7f54ac0b60b0 2024-04-13T02:46:18.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.440+0000 7f54abfff640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f549806c8f0 0x7f549806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.441+0000 7f54abfff640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f549806c8f0 0x7f549806edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f54a000ba50 tx=0x7f54a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.444+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f549c017020 con 0x7f54ac0b60b0 2024-04-13T02:46:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.619+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f54ac14a7e0 con 0x7f549806c8f0 2024-04-13T02:46:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.619+0000 7f54a8ff9640 1 -- 172.21.15.114:0/1139095680 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54ac14a7e0 con 0x7f549806c8f0 2024-04-13T02:46:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 6 to deep-scrub 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f549806c8f0 msgr2=0x7f549806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f549806c8f0 0x7f549806edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f54a000ba50 tx=0x7f54a0008040 comp rx=0 tx=0).stop 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 msgr2=0x7f54ac0afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0afaf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e7e0 tx=0x7f549c00eca0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 shutdown_connections 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ac0b0030 0x7f54ac1f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54ac0b60b0 0x7f54ac0afaf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f549806c8f0 0x7f549806edb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 --2- 172.21.15.114:0/1139095680 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54ac0b5790 0x7f54ac147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 >> 172.21.15.114:0/1139095680 conn(0x7f54ac06eb10 msgr2=0x7f54ac0aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 shutdown_connections 2024-04-13T02:46:18.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.621+0000 7f54b2915640 1 -- 172.21.15.114:0/1139095680 wait complete. 2024-04-13T02:46:18.633 INFO:tasks.ceph:Scrubbing osd.7 2024-04-13T02:46:18.633 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-13T02:46:18.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2024-04-13T02:46:18.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.736+0000 7fa42b1f7640 1 Processor -- start 2024-04-13T02:46:18.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.736+0000 7fa42b1f7640 1 -- start start 2024-04-13T02:46:18.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa42b1f7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4241462f0 0x7fa424072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa42b1f7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa42415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa42b1f7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4240ce000 con 0x7fa424072690 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa42b1f7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa4240a9640 con 0x7fa4241462f0 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa42b1f7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa424072af0 con 0x7fa4240cd850 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa428f93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4241462f0 0x7fa424072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa429794640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa42415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa423fff640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa424072690 0x7fa4240cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.114:44492/0 (socket says 172.21.15.114:44492) 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa429794640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa42415d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.114:57950/0 (socket says 172.21.15.114:57950) 2024-04-13T02:46:18.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa428f93640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4241462f0 0x7fa424072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.114:58144/0 (socket says 172.21.15.114:58144) 2024-04-13T02:46:18.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa423fff640 1 -- 172.21.15.114:0/1193783275 learned_addr learned my addr 172.21.15.114:0/1193783275 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:18.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa429794640 1 -- 172.21.15.114:0/1193783275 >> v2:172.21.15.130:3300/0 conn(0x7fa4241462f0 msgr2=0x7fa424072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:18.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa429794640 1 --2- 172.21.15.114:0/1193783275 >> v2:172.21.15.130:3300/0 conn(0x7fa4241462f0 0x7fa424072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa429794640 1 -- 172.21.15.114:0/1193783275 >> v1:172.21.15.130:6789/0 conn(0x7fa424072690 legacy=0x7fa4240cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.737+0000 7fa429794640 1 -- 172.21.15.114:0/1193783275 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4240cdd20 con 0x7fa4240cd850 2024-04-13T02:46:18.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.738+0000 7fa429794640 1 --2- 172.21.15.114:0/1193783275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa42415d9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009d90 tx=0x7fa41c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eebd4b1fe04ef99 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.738+0000 7fa4237fe640 1 -- 172.21.15.114:0/1193783275 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c039070 con 0x7fa4240cd850 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.738+0000 7fa4237fe640 1 -- 172.21.15.114:0/1193783275 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c02cce0 con 0x7fa4240cd850 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.738+0000 7fa4237fe640 1 -- 172.21.15.114:0/1193783275 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c034660 con 0x7fa4240cd850 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 -- 172.21.15.114:0/1193783275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 msgr2=0x7fa42415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 --2- 172.21.15.114:0/1193783275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa42415d9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009d90 tx=0x7fa41c02bf30 comp rx=0 tx=0).stop 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 -- 172.21.15.114:0/1193783275 shutdown_connections 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 --2- 172.21.15.114:0/1193783275 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa42415d9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 --2- 172.21.15.114:0/1193783275 >> v2:172.21.15.130:3300/0 conn(0x7fa4241462f0 0x7fa424072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 -- 172.21.15.114:0/1193783275 >> 172.21.15.114:0/1193783275 conn(0x7fa4240b2460 msgr2=0x7fa4240b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 -- 172.21.15.114:0/1193783275 shutdown_connections 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.739+0000 7fa42b1f7640 1 -- 172.21.15.114:0/1193783275 wait complete. 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.740+0000 7fa42b1f7640 1 Processor -- start 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.740+0000 7fa42b1f7640 1 -- start start 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa42b1f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa424072690 0x7fa4240cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa42b1f7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa4240ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa42b1f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4241462f0 0x7fa42413a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa42b1f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa42415d4d0 con 0x7fa4241462f0 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa42b1f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa42415d1f0 con 0x7fa424072690 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa42b1f7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa42415df30 con 0x7fa4240cd850 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4241462f0 0x7fa42413a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4241462f0 0x7fa42413a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59262/0 (socket says 172.21.15.114:59262) 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 -- 172.21.15.114:0/4063683705 learned_addr learned my addr 172.21.15.114:0/4063683705 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa428f93640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa424072690 0x7fa4240cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa423fff640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa4240ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 -- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 msgr2=0x7fa4240ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa4240ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 -- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa424072690 msgr2=0x7fa4240cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa424072690 0x7fa4240cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa429794640 1 -- 172.21.15.114:0/4063683705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4241f7a80 con 0x7fa4241462f0 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.741+0000 7fa423fff640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4240cd850 0x7fa4240ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa429794640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4241462f0 0x7fa42413a870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009eb0 tx=0x7fa41c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c039050 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c045070 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4240cbcd0 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c009450 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4240b3d90 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.742+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa424068db0 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.743+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa41c03e850 con 0x7fa4241462f0 2024-04-13T02:46:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.743+0000 7fa4217fa640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa40806c920 0x7fa40806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fa41c0ae460 con 0x7fa4241462f0 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa428f93640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa40806c920 0x7fa40806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa4217fa640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7fa408072880 0x7fa408074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 --> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa408075350 con 0x7fa408072880 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa41c0b5050 con 0x7fa4241462f0 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa423fff640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7fa408072880 0x7fa408074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa428f93640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa40806c920 0x7fa40806ede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa418009a30 tx=0x7fa418008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.744+0000 7fa423fff640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7fa408072880 0x7fa408074ca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.745+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== osd.7 v2:172.21.15.130:6824/1928234772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa408075350 con 0x7fa408072880 2024-04-13T02:46:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.758+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 --> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa4240b28e0 con 0x7fa408072880 2024-04-13T02:46:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa4217fa640 1 -- 172.21.15.114:0/4063683705 <== osd.7 v2:172.21.15.130:6824/1928234772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa4240b28e0 con 0x7fa408072880 2024-04-13T02:46:18.760 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-13T02:46:18.760 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-13T02:46:18.760 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-13T02:46:18.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7fa408072880 msgr2=0x7fa408074ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.130:6824/1928234772,v1:172.21.15.130:6825/1928234772] conn(0x7fa408072880 0x7fa408074ca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa40806c920 msgr2=0x7fa40806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fa40806c920 0x7fa40806ede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa418009a30 tx=0x7fa418008040 comp rx=0 tx=0).stop 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4241462f0 msgr2=0x7fa42413a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 --2- 172.21.15.114:0/4063683705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4241462f0 0x7fa42413a870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009eb0 tx=0x7fa41c004a40 comp rx=0 tx=0).stop 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa429794640 1 -- 172.21.15.114:0/4063683705 reap_dead start 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 shutdown_connections 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.759+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 >> 172.21.15.114:0/4063683705 conn(0x7fa4240b2460 msgr2=0x7fa42415e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.760+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 shutdown_connections 2024-04-13T02:46:18.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.760+0000 7fa42b1f7640 1 -- 172.21.15.114:0/4063683705 wait complete. 2024-04-13T02:46:18.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-13T02:46:18.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.871+0000 7fcc567f7640 1 Processor -- start 2024-04-13T02:46:18.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.871+0000 7fcc567f7640 1 -- start start 2024-04-13T02:46:18.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.871+0000 7fcc567f7640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcc5015c950 0x7fcc5006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.871+0000 7fcc567f7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5015d820 con 0x7fcc50067a40 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.871+0000 7fcc567f7640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5015db00 con 0x7fcc500b05b0 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.871+0000 7fcc567f7640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fcc500cdc80 con 0x7fcc5015c950 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcc50067a40 0x7fcc50160390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40822/0 (socket says 172.21.15.114:40822) 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4f7fe640 1 -- 172.21.15.114:0/3253435917 learned_addr learned my addr 172.21.15.114:0/3253435917 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4ffff640 1 --2- 172.21.15.114:0/3253435917 >> v2:172.21.15.130:3300/0 conn(0x7fcc5015c950 0x7fcc5006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4effd640 1 -- 172.21.15.114:0/3253435917 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647365473 0 0) 0x7fcc5015d820 con 0x7fcc50067a40 2024-04-13T02:46:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4effd640 1 -- 172.21.15.114:0/3253435917 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc38003520 con 0x7fcc50067a40 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4ffff640 1 -- 172.21.15.114:0/3253435917 >> v1:172.21.15.130:6789/0 conn(0x7fcc500b05b0 legacy=0x7fcc500cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4effd640 1 -- 172.21.15.114:0/3253435917 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3113877594 0 0) 0x7fcc38003520 con 0x7fcc50067a40 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4ffff640 1 -- 172.21.15.114:0/3253435917 >> v1:172.21.15.114:6789/0 conn(0x7fcc50067a40 legacy=0x7fcc50160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.872+0000 7fcc4ffff640 1 -- 172.21.15.114:0/3253435917 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500cdf60 con 0x7fcc5015c950 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.873+0000 7fcc4ffff640 1 --2- 172.21.15.114:0/3253435917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc5006b930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097a0 tx=0x7fcc4002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81de010e24b8c8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.873+0000 7fcc4effd640 1 -- 172.21.15.114:0/3253435917 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40038070 con 0x7fcc5015c950 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.873+0000 7fcc4effd640 1 -- 172.21.15.114:0/3253435917 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc40031500 con 0x7fcc5015c950 2024-04-13T02:46:18.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.873+0000 7fcc4effd640 1 -- 172.21.15.114:0/3253435917 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44001670 con 0x7fcc5015c950 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.873+0000 7fcc567f7640 1 -- 172.21.15.114:0/3253435917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 msgr2=0x7fcc5006b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.873+0000 7fcc567f7640 1 --2- 172.21.15.114:0/3253435917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc5006b930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097a0 tx=0x7fcc4002b820 comp rx=0 tx=0).stop 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.874+0000 7fcc567f7640 1 -- 172.21.15.114:0/3253435917 shutdown_connections 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.874+0000 7fcc567f7640 1 --2- 172.21.15.114:0/3253435917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc5006b930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.874+0000 7fcc567f7640 1 -- 172.21.15.114:0/3253435917 >> 172.21.15.114:0/3253435917 conn(0x7fcc5006eb10 msgr2=0x7fcc5006ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.874+0000 7fcc567f7640 1 -- 172.21.15.114:0/3253435917 shutdown_connections 2024-04-13T02:46:18.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.874+0000 7fcc567f7640 1 -- 172.21.15.114:0/3253435917 wait complete. 2024-04-13T02:46:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.875+0000 7fcc567f7640 1 Processor -- start 2024-04-13T02:46:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.875+0000 7fcc567f7640 1 -- start start 2024-04-13T02:46:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc50067a40 0x7fcc50156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 0x7fcc5014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc500aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcc50160aa0 con 0x7fcc500b05b0 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5006be70 con 0x7fcc5015c950 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcc50160c20 con 0x7fcc50067a40 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 0x7fcc5014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 0x7fcc5014e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59264/0 (socket says 172.21.15.114:59264) 2024-04-13T02:46:18.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 -- 172.21.15.114:0/4233975650 learned_addr learned my addr 172.21.15.114:0/4233975650 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc54d94640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc500aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4ffff640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc50067a40 0x7fcc50156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 -- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc50067a40 msgr2=0x7fcc50156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc50067a40 0x7fcc50156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 -- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 msgr2=0x7fcc500aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc500aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 -- 172.21.15.114:0/4233975650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500c62e0 con 0x7fcc500b05b0 2024-04-13T02:46:18.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4f7fe640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 0x7fcc5014e5e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c700 tx=0x7fcc4400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44017070 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc44005ad0 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc500ae6b0 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44007070 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.876+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc500c65c0 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.877+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc50068c80 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.878+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc4401a070 con 0x7fcc500b05b0 2024-04-13T02:46:18.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.878+0000 7fcc4cff9640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:18.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.878+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fcc4408ace0 con 0x7fcc500b05b0 2024-04-13T02:46:18.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.878+0000 7fcc4ffff640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:18.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.878+0000 7fcc4ffff640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc40035000 tx=0x7fcc40008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:18.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:18.882+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc44058d70 con 0x7fcc500b05b0 2024-04-13T02:46:19.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.055+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fcc500c6090 con 0x7fcc3c06c8f0 2024-04-13T02:46:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.056+0000 7fcc4cff9640 1 -- 172.21.15.114:0/4233975650 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcc500c6090 con 0x7fcc3c06c8f0 2024-04-13T02:46:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 7 to deep-scrub 2024-04-13T02:46:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcc3c06c8f0 msgr2=0x7fcc3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc40035000 tx=0x7fcc40008030 comp rx=0 tx=0).stop 2024-04-13T02:46:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 msgr2=0x7fcc5014e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 0x7fcc5014e5e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c700 tx=0x7fcc4400cbc0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 shutdown_connections 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc5015c950 0x7fcc500aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc500b05b0 0x7fcc5014e5e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 --2- 172.21.15.114:0/4233975650 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc50067a40 0x7fcc50156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 >> 172.21.15.114:0/4233975650 conn(0x7fcc5006eb10 msgr2=0x7fcc50157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 shutdown_connections 2024-04-13T02:46:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.058+0000 7fcc567f7640 1 -- 172.21.15.114:0/4233975650 wait complete. 2024-04-13T02:46:19.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:46:19.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.169+0000 7f8647988640 1 Processor -- start 2024-04-13T02:46:19.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.169+0000 7f8647988640 1 -- start start 2024-04-13T02:46:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8647988640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f864015edb0 0x7f864009ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8647988640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86400b3ec0 0x7f864009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8647988640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f864006d450 0x7f86400c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8647988640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f86400cce20 con 0x7f864015edb0 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8647988640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f864006cd90 con 0x7f864006d450 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8647988640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f864006d070 con 0x7f86400b3ec0 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f864015edb0 0x7f864009ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f864015edb0 0x7f864009ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59266/0 (socket says 172.21.15.114:59266) 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 -- 172.21.15.114:0/1354779083 learned_addr learned my addr 172.21.15.114:0/1354779083 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8644f23640 1 --2- 172.21.15.114:0/1354779083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86400b3ec0 0x7f864009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645f25640 1 --2- 172.21.15.114:0/1354779083 >> v2:172.21.15.130:3300/0 conn(0x7f864006d450 0x7f86400c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 -- 172.21.15.114:0/1354779083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86400b3ec0 msgr2=0x7f864009b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:19.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 --2- 172.21.15.114:0/1354779083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86400b3ec0 0x7f864009b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 -- 172.21.15.114:0/1354779083 >> v2:172.21.15.130:3300/0 conn(0x7f864006d450 msgr2=0x7f86400c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:19.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 --2- 172.21.15.114:0/1354779083 >> v2:172.21.15.130:3300/0 conn(0x7f864006d450 0x7f86400c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645724640 1 -- 172.21.15.114:0/1354779083 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86400cd070 con 0x7f864015edb0 2024-04-13T02:46:19.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.170+0000 7f8645f25640 1 --2- 172.21.15.114:0/1354779083 >> v2:172.21.15.130:3300/0 conn(0x7f864006d450 0x7f86400c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:19.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.171+0000 7f8645724640 1 --2- 172.21.15.114:0/1354779083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f864015edb0 0x7f864009ab90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f86400733b0 tx=0x7f863c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7445c8d551f30dba server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:19.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8637fff640 1 -- 172.21.15.114:0/1354779083 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c02e070 con 0x7f864015edb0 2024-04-13T02:46:19.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8637fff640 1 -- 172.21.15.114:0/1354779083 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c037070 con 0x7f864015edb0 2024-04-13T02:46:19.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8637fff640 1 -- 172.21.15.114:0/1354779083 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c031a00 con 0x7f864015edb0 2024-04-13T02:46:19.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 -- 172.21.15.114:0/1354779083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f864015edb0 msgr2=0x7f864009ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 --2- 172.21.15.114:0/1354779083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f864015edb0 0x7f864009ab90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f86400733b0 tx=0x7f863c02b880 comp rx=0 tx=0).stop 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 -- 172.21.15.114:0/1354779083 shutdown_connections 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 --2- 172.21.15.114:0/1354779083 >> v2:172.21.15.130:3300/0 conn(0x7f864006d450 0x7f86400c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 --2- 172.21.15.114:0/1354779083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86400b3ec0 0x7f864009b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 --2- 172.21.15.114:0/1354779083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f864015edb0 0x7f864009ab90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 -- 172.21.15.114:0/1354779083 >> 172.21.15.114:0/1354779083 conn(0x7f86400d27d0 msgr2=0x7f86400d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 -- 172.21.15.114:0/1354779083 shutdown_connections 2024-04-13T02:46:19.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.175+0000 7f8647988640 1 -- 172.21.15.114:0/1354779083 wait complete. 2024-04-13T02:46:19.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 Processor -- start 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 -- start start 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864006d450 0x7f86400c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 0x7f86400b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864015edb0 0x7f86400b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86400c8070 con 0x7f86400b3ec0 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f864006ca40 con 0x7f864015edb0 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8647988640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f86400c81f0 con 0x7f864006d450 2024-04-13T02:46:19.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8644f23640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 0x7f86400b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8644f23640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 0x7f86400b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59276/0 (socket says 172.21.15.114:59276) 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.177+0000 7f8644f23640 1 -- 172.21.15.114:0/3726485550 learned_addr learned my addr 172.21.15.114:0/3726485550 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8645724640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864006d450 0x7f86400c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8645f25640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864015edb0 0x7f86400b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8644f23640 1 -- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864006d450 msgr2=0x7f86400c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8644f23640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864006d450 0x7f86400c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8644f23640 1 -- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864015edb0 msgr2=0x7f86400b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8644f23640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864015edb0 0x7f86400b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8644f23640 1 -- 172.21.15.114:0/3726485550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8640160a80 con 0x7f86400b3ec0 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8644f23640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 0x7f86400b6520 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f863000d800 tx=0x7f863000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863000b6c0 con 0x7f86400b3ec0 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8630019070 con 0x7f86400b3ec0 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86400cc4f0 con 0x7f86400b3ec0 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863000ba80 con 0x7f86400b3ec0 2024-04-13T02:46:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.178+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8640161000 con 0x7f86400b3ec0 2024-04-13T02:46:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.179+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8640068c80 con 0x7f86400b3ec0 2024-04-13T02:46:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.179+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f863000bc20 con 0x7f86400b3ec0 2024-04-13T02:46:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.180+0000 7f8635ffb640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f862406c920 0x7f862406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.180+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f863008bcf0 con 0x7f86400b3ec0 2024-04-13T02:46:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.180+0000 7f8645724640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f862406c920 0x7f862406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.180+0000 7f8645724640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f862406c920 0x7f862406ede0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f863c036000 tx=0x7f863c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.184+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8630090070 con 0x7f86400b3ec0 2024-04-13T02:46:19.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.358+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86400c9f60 con 0x7f862406c920 2024-04-13T02:46:19.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.359+0000 7f8635ffb640 1 -- 172.21.15.114:0/3726485550 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13474 (secure 0 0 0) 0x7f86400c9f60 con 0x7f862406c920 2024-04-13T02:46:19.360 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:19.360 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f862406c920 msgr2=0x7f862406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f862406c920 0x7f862406ede0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f863c036000 tx=0x7f863c03d040 comp rx=0 tx=0).stop 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 msgr2=0x7f86400b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 0x7f86400b6520 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f863000d800 tx=0x7f863000dcc0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 shutdown_connections 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f864015edb0 0x7f86400b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86400b3ec0 0x7f86400b6520 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f862406c920 0x7f862406ede0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 --2- 172.21.15.114:0/3726485550 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f864006d450 0x7f86400c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 >> 172.21.15.114:0/3726485550 conn(0x7f86400d27d0 msgr2=0x7f86400ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 shutdown_connections 2024-04-13T02:46:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:19.361+0000 7f8647988640 1 -- 172.21.15.114:0/3726485550 wait complete. 2024-04-13T02:46:19.372 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-13T02:46:17.507448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220924,"kb_used_data":4728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753796,"statfs":{"total":773094113280,"available":772867887104,"internally_reserved":0,"allocated":4841472,"data_stored":2660856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001298"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T02:46:11.155838+0000","last_change":"2024-04-13T02:44:28.638715+0000","last_active":"2024-04-13T02:46:11.155838+0000","last_peered":"2024-04-13T02:46:11.155838+0000","last_clean":"2024-04-13T02:46:11.155838+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:46:11.155838+0000","last_undegraded":"2024-04-13T02:46:11.155838+0000","last_fullsized":"2024-04-13T02:46:11.155838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-13T02:44:27.511914+0000","last_clean_scrub_stamp":"2024-04-13T02:44:27.511914+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:18:44.906328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":180087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:46:19.375 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-13T02:44:27.511914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=13, tm_hour=2, tm_min=44, tm_sec=27, tm_wday=5, tm_yday=104, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=13, tm_hour=2, tm_min=46, tm_sec=14, tm_wday=5, tm_yday=104, tm_isdst=0) 2024-04-13T02:46:19.375 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-13T02:46:25.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2024-04-13T02:46:31.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2024-04-13T02:46:34.290 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:34.293 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:38.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2024-04-13T02:46:39.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-13T02:46:39.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.487+0000 7f48915a3640 1 Processor -- start 2024-04-13T02:46:39.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.487+0000 7f48915a3640 1 -- start start 2024-04-13T02:46:39.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f48915a3640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f488c146310 0x7f488c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f48915a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f488c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f48915a3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488c0b2970 con 0x7f488c0af5d0 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f48915a3640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f488c1466f0 con 0x7f488c146310 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f48915a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0afa20 con 0x7f488c0b1200 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f488b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f488c0af5d0 0x7f488c06b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57234/0 (socket says 172.21.15.114:57234) 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f488b7fe640 1 -- 172.21.15.114:0/3919626318 learned_addr learned my addr 172.21.15.114:0/3919626318 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f488affd640 1 --2- 172.21.15.114:0/3919626318 >> v2:172.21.15.130:3300/0 conn(0x7f488c146310 0x7f488c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.488+0000 7f488a7fc640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f488c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444511489 0 0) 0x7f488c0b2970 con 0x7f488c0af5d0 2024-04-13T02:46:39.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4874003520 con 0x7f488c0af5d0 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 704078637 0 0) 0x7f4874003520 con 0x7f488c0af5d0 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 msgr2=0x7f488c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f488c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 >> v2:172.21.15.130:3300/0 conn(0x7f488c146310 msgr2=0x7f488c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 --2- 172.21.15.114:0/3919626318 >> v2:172.21.15.130:3300/0 conn(0x7f488c146310 0x7f488c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c0b2c50 con 0x7f488c0af5d0 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 673373133 0 0) 0x7f4884001670 con 0x7f488c0af5d0 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488a7fc640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f488c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:39.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 >> v1:172.21.15.114:6789/0 conn(0x7f488c0af5d0 legacy=0x7f488c06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f48740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4874003ef0 0x7f4874004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4874004d40 0x7f48740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0afa20 con 0x7f4874004d40 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f487400b9c0 con 0x7f4874003ef0 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f487400bb40 con 0x7f488c0b1200 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488affd640 1 --2- 172.21.15.114:0/3919626318 >> v2:172.21.15.130:3300/0 conn(0x7f488c146310 0x7f488c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:39.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488b7fe640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4874004d40 0x7f48740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488a7fc640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4874003ef0 0x7f4874004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488affd640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f48740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488b7fe640 1 -- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 msgr2=0x7f48740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488b7fe640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f48740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488b7fe640 1 -- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4874003ef0 msgr2=0x7f4874004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488b7fe640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4874003ef0 0x7f4874004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488b7fe640 1 -- 172.21.15.114:0/3919626318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4874003520 con 0x7f4874004d40 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.489+0000 7f488affd640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c0b1200 0x7f48740039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:39.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.490+0000 7f488b7fe640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4874004d40 0x7f48740051c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f488400c290 tx=0x7f4874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e88e488208f300 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.490+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884007d50 con 0x7f4874004d40 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.490+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884030070 con 0x7f4874004d40 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.490+0000 7f4889ffb640 1 -- 172.21.15.114:0/3919626318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488402cdc0 con 0x7f4874004d40 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f48915a3640 1 -- 172.21.15.114:0/3919626318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4874004d40 msgr2=0x7f48740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f48915a3640 1 --2- 172.21.15.114:0/3919626318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4874004d40 0x7f48740051c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f488400c290 tx=0x7f4874005830 comp rx=0 tx=0).stop 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f488b7fe640 1 -- 172.21.15.114:0/3919626318 reap_dead start 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f48915a3640 1 -- 172.21.15.114:0/3919626318 shutdown_connections 2024-04-13T02:46:39.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f48915a3640 1 -- 172.21.15.114:0/3919626318 >> 172.21.15.114:0/3919626318 conn(0x7f488c0b6f50 msgr2=0x7f488c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:39.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f48915a3640 1 -- 172.21.15.114:0/3919626318 shutdown_connections 2024-04-13T02:46:39.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.491+0000 7f48915a3640 1 -- 172.21.15.114:0/3919626318 wait complete. 2024-04-13T02:46:39.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.492+0000 7f48915a3640 1 Processor -- start 2024-04-13T02:46:39.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.492+0000 7f48915a3640 1 -- start start 2024-04-13T02:46:39.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f48915a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 0x7f488c09b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f48915a3640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f488c13d5f0 0x7f488c13da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f48915a3640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c13b980 0x7f488c13be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f48915a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f488c15cf10 con 0x7f488c1f5840 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f48915a3640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0b3210 con 0x7f488c13d5f0 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f48915a3640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0b2520 con 0x7f488c13b980 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 0x7f488c09b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 0x7f488c09b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39746/0 (socket says 172.21.15.114:39746) 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 -- 172.21.15.114:0/1861341755 learned_addr learned my addr 172.21.15.114:0/1861341755 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:39.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488a7fc640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f488c13d5f0 0x7f488c13da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 -- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c13b980 msgr2=0x7f488c13be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c13b980 0x7f488c13be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 -- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f488c13d5f0 msgr2=0x7f488c13da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f488c13d5f0 0x7f488c13da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.493+0000 7f488affd640 1 -- 172.21.15.114:0/1861341755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c13dfb0 con 0x7f488c1f5840 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.494+0000 7f488affd640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 0x7f488c09b900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f487c011530 tx=0x7f487c0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.494+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c01a020 con 0x7f488c1f5840 2024-04-13T02:46:39.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.494+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c016680 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.494+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c13a8e0 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.494+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c016a30 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.494+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c13aea0 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.495+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c068c80 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.495+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f487c005d10 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.496+0000 7f48737fe640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f487806c920 0x7f487806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.496+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f487c08c9a0 con 0x7f488c1f5840 2024-04-13T02:46:39.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.496+0000 7f488a7fc640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f487806c920 0x7f487806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.496+0000 7f488a7fc640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f487806c920 0x7f487806ede0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f488c0d08d0 tx=0x7f4880008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:39.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.500+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f488c13dfb0 con 0x7f488c1f5840 2024-04-13T02:46:39.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.672+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 --> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f488c0b1bd0 con 0x7f487806c920 2024-04-13T02:46:39.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.672+0000 7f48737fe640 1 -- 172.21.15.114:0/1861341755 <== mgr.4113 v2:172.21.15.114:6832/1298227515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13358 (secure 0 0 0) 0x7f488c0b1bd0 con 0x7f487806c920 2024-04-13T02:46:39.674 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:39.674 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-04-13T02:46:39.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f487806c920 msgr2=0x7f487806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f487806c920 0x7f487806ede0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f488c0d08d0 tx=0x7f4880008040 comp rx=0 tx=0).stop 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 msgr2=0x7f488c09b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 0x7f488c09b900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f487c011530 tx=0x7f487c0119f0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 shutdown_connections 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f487806c920 0x7f487806ede0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f488c13b980 0x7f488c13be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f488c13d5f0 0x7f488c13da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 --2- 172.21.15.114:0/1861341755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c1f5840 0x7f488c09b900 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.674+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 >> 172.21.15.114:0/1861341755 conn(0x7f488c0b6f50 msgr2=0x7f488c143730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:39.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.675+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 shutdown_connections 2024-04-13T02:46:39.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.675+0000 7f48915a3640 1 -- 172.21.15.114:0/1861341755 wait complete. 2024-04-13T02:46:39.686 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-04-13T02:46:39.511821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220920,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753800,"statfs":{"total":773094113280,"available":772867891200,"internally_reserved":0,"allocated":4857856,"data_stored":2666488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"1.0","version":"39'119","reported_seq":220,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-13T02:46:19.301737+0000","last_change":"2024-04-13T02:46:19.301737+0000","last_active":"2024-04-13T02:46:19.301737+0000","last_peered":"2024-04-13T02:46:19.301737+0000","last_clean":"2024-04-13T02:46:19.301737+0000","last_became_active":"2024-04-13T02:44:28.637815+0000","last_became_peered":"2024-04-13T02:44:28.637815+0000","last_unstale":"2024-04-13T02:46:19.301737+0000","last_undegraded":"2024-04-13T02:46:19.301737+0000","last_fullsized":"2024-04-13T02:46:19.301737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-13T02:46:19.301608+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-13T02:46:19.301608+0000","last_clean_scrub_stamp":"2024-04-13T02:46:19.301608+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:26:09.253510+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":185719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1052672,"data_stored":776087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-13T02:46:39.687 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-13T02:46:39.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.786+0000 7fc3c44de640 1 Processor -- start 2024-04-13T02:46:39.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.786+0000 7fc3c44de640 1 -- start start 2024-04-13T02:46:39.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.786+0000 7fc3c44de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc0ce650 0x7fc3bc09ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.786+0000 7fc3c44de640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc3bc0703d0 0x7fc3bc09b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c44de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc071330 con 0x7fc3bc06d2e0 2024-04-13T02:46:39.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c44de640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc3bc09bb40 con 0x7fc3bc0703d0 2024-04-13T02:46:39.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c44de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc06ce50 con 0x7fc3bc0ce650 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c2a7b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc3bc06d2e0 0x7fc3bc06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57250/0 (socket says 172.21.15.114:57250) 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c2a7b640 1 -- 172.21.15.114:0/3923996385 learned_addr learned my addr 172.21.15.114:0/3923996385 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1a79640 1 --2- 172.21.15.114:0/3923996385 >> v2:172.21.15.130:3300/0 conn(0x7fc3bc0703d0 0x7fc3bc09b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c227a640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc0ce650 0x7fc3bc09ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1278640 1 -- 172.21.15.114:0/3923996385 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516409580 0 0) 0x7fc3bc071330 con 0x7fc3bc06d2e0 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1278640 1 -- 172.21.15.114:0/3923996385 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a8003520 con 0x7fc3bc06d2e0 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1a79640 1 -- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc0ce650 msgr2=0x7fc3bc09ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1a79640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc0ce650 0x7fc3bc09ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1278640 1 -- 172.21.15.114:0/3923996385 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 995209073 0 0) 0x7fc3a8003520 con 0x7fc3bc06d2e0 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1a79640 1 -- 172.21.15.114:0/3923996385 >> v1:172.21.15.114:6789/0 conn(0x7fc3bc06d2e0 legacy=0x7fc3bc06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c1a79640 1 -- 172.21.15.114:0/3923996385 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc06cae0 con 0x7fc3bc0703d0 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.787+0000 7fc3c227a640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc0ce650 0x7fc3bc09ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.788+0000 7fc3c1a79640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc09b060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0097a0 tx=0x7fc3ac02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a9384ca6bab79d server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.788+0000 7fc3c1278640 1 -- 172.21.15.114:0/3923996385 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac037070 con 0x7fc3bc0703d0 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.788+0000 7fc3c1278640 1 -- 172.21.15.114:0/3923996385 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ac030510 con 0x7fc3bc0703d0 2024-04-13T02:46:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.788+0000 7fc3c1278640 1 -- 172.21.15.114:0/3923996385 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4001670 con 0x7fc3bc0703d0 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 -- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 msgr2=0x7fc3bc09b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc09b060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0097a0 tx=0x7fc3ac02b790 comp rx=0 tx=0).stop 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 -- 172.21.15.114:0/3923996385 shutdown_connections 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc09b060 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 --2- 172.21.15.114:0/3923996385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc0ce650 0x7fc3bc09ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 -- 172.21.15.114:0/3923996385 >> 172.21.15.114:0/3923996385 conn(0x7fc3bc0d2720 msgr2=0x7fc3bc0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:39.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 -- 172.21.15.114:0/3923996385 shutdown_connections 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.789+0000 7fc3c44de640 1 -- 172.21.15.114:0/3923996385 wait complete. 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.790+0000 7fc3c44de640 1 Processor -- start 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.790+0000 7fc3c44de640 1 -- start start 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c44de640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc06d2e0 0x7fc3bc0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c44de640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c44de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 0x7fc3bc0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c44de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc09bd90 con 0x7fc3bc0ce650 2024-04-13T02:46:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c44de640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc071610 con 0x7fc3bc0703d0 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c44de640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc0cea30 con 0x7fc3bc06d2e0 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 0x7fc3bc0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 0x7fc3bc0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39758/0 (socket says 172.21.15.114:39758) 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 -- 172.21.15.114:0/1005907340 learned_addr learned my addr 172.21.15.114:0/1005907340 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c1a79640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c227a640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc06d2e0 0x7fc3bc0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 -- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc06d2e0 msgr2=0x7fc3bc0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc06d2e0 0x7fc3bc0b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 -- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 msgr2=0x7fc3bc15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 -- 172.21.15.114:0/1005907340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc0b6b40 con 0x7fc3bc0ce650 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c1a79640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.791+0000 7fc3c2a7b640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 0x7fc3bc0ccd70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400c750 tx=0x7fc3b400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.792+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4005ad0 con 0x7fc3bc0ce650 2024-04-13T02:46:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.792+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b4005c90 con 0x7fc3bc0ce650 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.792+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc0b6e20 con 0x7fc3bc0ce650 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.792+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40072b0 con 0x7fc3bc0ce650 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.792+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc15f230 con 0x7fc3bc0ce650 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.793+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc0b7340 con 0x7fc3bc0ce650 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.793+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3b4007450 con 0x7fc3bc0ce650 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.793+0000 7fc3b2ffd640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc3a006c920 0x7fc3a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.794+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7fc3b408b620 con 0x7fc3bc0ce650 2024-04-13T02:46:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.794+0000 7fc3c227a640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc3a006c920 0x7fc3a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.794+0000 7fc3c227a640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc3a006c920 0x7fc3a006ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0b4130 tx=0x7fc3b800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.798+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3bc0b7340 con 0x7fc3bc0ce650 2024-04-13T02:46:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.972+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc3bc068c80 con 0x7fc3bc0ce650 2024-04-13T02:46:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.975+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7fc3b4059d80 con 0x7fc3bc0ce650 2024-04-13T02:46:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.976+0000 7fc3b2ffd640 1 -- 172.21.15.114:0/1005907340 <== mon.0 v2:172.21.15.114:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc3b4005e40 con 0x7fc3bc0ce650 2024-04-13T02:46:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc3a006c920 msgr2=0x7fc3a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc3a006c920 0x7fc3a006ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0b4130 tx=0x7fc3b800b040 comp rx=0 tx=0).stop 2024-04-13T02:46:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 msgr2=0x7fc3bc0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 0x7fc3bc0ccd70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400c750 tx=0x7fc3b400cc10 comp rx=0 tx=0).stop 2024-04-13T02:46:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 shutdown_connections 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3bc0ce650 0x7fc3bc0ccd70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3bc0703d0 0x7fc3bc15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7fc3a006c920 0x7fc3a006ede0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 --2- 172.21.15.114:0/1005907340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc3bc06d2e0 0x7fc3bc0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 >> 172.21.15.114:0/1005907340 conn(0x7fc3bc0d2720 msgr2=0x7fc3bc1611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 shutdown_connections 2024-04-13T02:46:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:39.978+0000 7fc3c44de640 1 -- 172.21.15.114:0/1005907340 wait complete. 2024-04-13T02:46:39.990 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-13T02:46:39.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-13T02:46:40.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.090+0000 7f8a8f75e640 1 Processor -- start 2024-04-13T02:46:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.090+0000 7f8a8f75e640 1 -- start start 2024-04-13T02:46:40.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8f75e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a880cefc0 0x7f8a880b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8f75e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880b4be0 con 0x7f8a881461f0 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8f75e640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880b4620 con 0x7f8a880b3e10 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8f75e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880a9640 con 0x7f8a880cefc0 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8ccf9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a880cefc0 0x7f8a880b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8ccf9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a880cefc0 0x7f8a880b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39772/0 (socket says 172.21.15.114:39772) 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8d4fa640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8a881461f0 0x7f8a880ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57252/0 (socket says 172.21.15.114:57252) 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8ccf9640 1 -- 172.21.15.114:0/3714051033 learned_addr learned my addr 172.21.15.114:0/3714051033 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8ccf9640 1 -- 172.21.15.114:0/3714051033 >> v1:172.21.15.130:6789/0 conn(0x7f8a880b3e10 legacy=0x7f8a8815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8ccf9640 1 -- 172.21.15.114:0/3714051033 >> v1:172.21.15.114:6789/0 conn(0x7f8a881461f0 legacy=0x7f8a880ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a8ccf9640 1 -- 172.21.15.114:0/3714051033 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880b4900 con 0x7f8a880cefc0 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.091+0000 7f8a7ffff640 1 -- 172.21.15.114:0/3714051033 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348300560 0 0) 0x7f8a880b4be0 con 0x7f8a881461f0 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a8ccf9640 1 --2- 172.21.15.114:0/3714051033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880cefc0 0x7f8a880b38d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009870 tx=0x7f8a7802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7efd4744513a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a7ffff640 1 -- 172.21.15.114:0/3714051033 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78034070 con 0x7f8a880cefc0 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a7ffff640 1 -- 172.21.15.114:0/3714051033 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a78030860 con 0x7f8a880cefc0 2024-04-13T02:46:40.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a7ffff640 1 -- 172.21.15.114:0/3714051033 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78030c50 con 0x7f8a880cefc0 2024-04-13T02:46:40.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a8f75e640 1 -- 172.21.15.114:0/3714051033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880cefc0 msgr2=0x7f8a880b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:40.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/3714051033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880cefc0 0x7f8a880b38d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009870 tx=0x7f8a7802b9a0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a8f75e640 1 -- 172.21.15.114:0/3714051033 shutdown_connections 2024-04-13T02:46:40.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/3714051033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880cefc0 0x7f8a880b38d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.092+0000 7f8a8f75e640 1 -- 172.21.15.114:0/3714051033 >> 172.21.15.114:0/3714051033 conn(0x7f8a880b27b0 msgr2=0x7f8a880b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.093+0000 7f8a8f75e640 1 -- 172.21.15.114:0/3714051033 shutdown_connections 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.093+0000 7f8a8f75e640 1 -- 172.21.15.114:0/3714051033 wait complete. 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 Processor -- start 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 -- start start 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 0x7f8a8813c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a880cefc0 0x7f8a8813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a881461f0 0x7f8a881403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:40.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881465d0 con 0x7f8a880b3e10 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8815d310 con 0x7f8a881461f0 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8f75e640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880b4280 con 0x7f8a880cefc0 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8d4fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 0x7f8a8813c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8d4fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 0x7f8a8813c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39776/0 (socket says 172.21.15.114:39776) 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.094+0000 7f8a8d4fa640 1 -- 172.21.15.114:0/1991899199 learned_addr learned my addr 172.21.15.114:0/1991899199 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8dcfb640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a881461f0 0x7f8a881403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8ccf9640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a880cefc0 0x7f8a8813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:40.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8d4fa640 1 -- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a880cefc0 msgr2=0x7f8a8813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8d4fa640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a880cefc0 0x7f8a8813fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8d4fa640 1 -- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a881461f0 msgr2=0x7f8a881403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8d4fa640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a881461f0 0x7f8a881403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8d4fa640 1 -- 172.21.15.114:0/1991899199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8815f040 con 0x7f8a880b3e10 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8ccf9640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a880cefc0 0x7f8a8813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8dcfb640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a881461f0 0x7f8a881403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8d4fa640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 0x7f8a8813c250 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c460 tx=0x7f8a8400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84018070 con 0x7f8a880b3e10 2024-04-13T02:46:40.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a84007500 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8815f320 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84004a40 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.095+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8815e430 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.096+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a880757d0 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.096+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a8401b070 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.097+0000 7f8a7dffb640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.097+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5029+0+0 (secure 0 0 0) 0x7f8a8408ac50 con 0x7f8a880b3e10 2024-04-13T02:46:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.097+0000 7f8a8ccf9640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-13T02:46:40.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.097+0000 7f8a8ccf9640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a78036000 tx=0x7f8a7803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-13T02:46:40.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.102+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a880757d0 con 0x7f8a880b3e10 2024-04-13T02:46:40.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.312+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a880d0000 con 0x7f8a880b3e10 2024-04-13T02:46:40.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.313+0000 7f8a7dffb640 1 -- 172.21.15.114:0/1991899199 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3050 (secure 0 0 0) 0x7f8a880d0000 con 0x7f8a880b3e10 2024-04-13T02:46:40.314 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-13T02:46:40.314 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4876,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/646509443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":646509443},{"type":"v1","addr":"172.21.15.130:6834","nonce":646509443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1012000722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1012000722},{"type":"v1","addr":"172.21.15.130:6835","nonce":1012000722}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5559,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1128261242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1128261242},{"type":"v1","addr":"172.21.15.114:6835","nonce":1128261242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-04-13T02:46:40.314 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2024-04-13T02:46:40.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a6c06c8f0 msgr2=0x7f8a6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a78036000 tx=0x7f8a7803b040 comp rx=0 tx=0).stop 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 msgr2=0x7f8a8813c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 0x7f8a8813c250 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c460 tx=0x7f8a8400c920 comp rx=0 tx=0).stop 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 shutdown_connections 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a881461f0 0x7f8a881403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:6832/1298227515,v1:172.21.15.114:6833/1298227515] conn(0x7f8a6c06c8f0 0x7f8a6c06edb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8a880cefc0 0x7f8a8813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 --2- 172.21.15.114:0/1991899199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a880b3e10 0x7f8a8813c250 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-13T02:46:40.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 >> 172.21.15.114:0/1991899199 conn(0x7f8a880b27b0 msgr2=0x7f8a881423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-13T02:46:40.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 shutdown_connections 2024-04-13T02:46:40.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-13T02:46:40.315+0000 7f8a8f75e640 1 -- 172.21.15.114:0/1991899199 wait complete. 2024-04-13T02:46:40.326 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-13T02:46:40.326 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-13T02:46:40.327 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-13T02:46:40.327 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:40.327 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-13T02:46:40.333 INFO:tasks.ceph.mds.a:Stopped 2024-04-13T02:46:40.333 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-13T02:46:40.333 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.342 INFO:tasks.ceph.mds.c:Stopped 2024-04-13T02:46:40.343 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-13T02:46:40.343 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.355 INFO:tasks.ceph.mds.b:Stopped 2024-04-13T02:46:40.355 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-13T02:46:40.355 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.406 INFO:tasks.ceph.mds.d:Stopped 2024-04-13T02:46:40.407 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-13T02:46:40.407 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-13T02:46:40.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.435 INFO:tasks.ceph.osd.0:Stopped 2024-04-13T02:46:40.435 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-13T02:46:40.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.514 INFO:tasks.ceph.osd.1:Stopped 2024-04-13T02:46:40.514 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-13T02:46:40.514 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.580 INFO:tasks.ceph.osd.2:Stopped 2024-04-13T02:46:40.580 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-13T02:46:40.580 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.651 INFO:tasks.ceph.osd.3:Stopped 2024-04-13T02:46:40.651 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-13T02:46:40.651 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.685 INFO:tasks.ceph.osd.4:Stopped 2024-04-13T02:46:40.685 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-13T02:46:40.685 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.756 INFO:tasks.ceph.osd.5:Stopped 2024-04-13T02:46:40.757 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-13T02:46:40.757 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.827 INFO:tasks.ceph.osd.6:Stopped 2024-04-13T02:46:40.828 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-13T02:46:40.828 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.896 INFO:tasks.ceph.osd.7:Stopped 2024-04-13T02:46:40.896 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-13T02:46:40.896 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-13T02:46:40.896 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.922 INFO:tasks.ceph.mgr.y:Stopped 2024-04-13T02:46:40.922 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-13T02:46:40.922 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.965 INFO:tasks.ceph.mgr.x:Stopped 2024-04-13T02:46:40.965 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-13T02:46:40.966 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-13T02:46:40.966 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:40.976 INFO:tasks.ceph.mon.a:Stopped 2024-04-13T02:46:40.977 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-13T02:46:40.977 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:41.018 INFO:tasks.ceph.mon.b:Stopped 2024-04-13T02:46:41.019 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-13T02:46:41.019 INFO:teuthology.orchestra.run:waiting for 300 2024-04-13T02:46:41.071 INFO:tasks.ceph.mon.c:Stopped 2024-04-13T02:46:41.071 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-13T02:46:41.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-13T02:46:41.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:46:41.105 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-13T02:46:41.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:46:41.298 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-13T02:46:41.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:46:41.364 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-13T02:46:41.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:46:41.430 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-13T02:46:41.488 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:46:41.489 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-13T02:46:41.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:46:41.607 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-13T02:46:41.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:46:41.687 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-13T02:46:41.735 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:46:41.735 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-13T02:46:41.835 INFO:tasks.ceph:Archiving mon data... 2024-04-13T02:46:41.836 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/data/mon.a.tgz 2024-04-13T02:46:41.837 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-04-13T02:46:41.852 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.C46Nq8AwiF 2024-04-13T02:46:41.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.C46Nq8AwiF 2024-04-13T02:46:41.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.C46Nq8AwiF 2024-04-13T02:46:42.080 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.C46Nq8AwiF is 291KB 2024-04-13T02:46:42.177 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.C46Nq8AwiF 2024-04-13T02:46:42.193 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/data/mon.b.tgz 2024-04-13T02:46:42.193 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-13T02:46:42.210 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.E9wkjIphNo 2024-04-13T02:46:42.211 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.E9wkjIphNo 2024-04-13T02:46:42.360 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.E9wkjIphNo 2024-04-13T02:46:42.445 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.E9wkjIphNo is 389KB 2024-04-13T02:46:42.545 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.E9wkjIphNo 2024-04-13T02:46:42.560 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/data/mon.c.tgz 2024-04-13T02:46:42.560 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-13T02:46:42.614 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.x92pa44eSn 2024-04-13T02:46:42.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.x92pa44eSn 2024-04-13T02:46:42.751 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.x92pa44eSn 2024-04-13T02:46:42.835 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.x92pa44eSn is 389KB 2024-04-13T02:46:42.931 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.x92pa44eSn 2024-04-13T02:46:42.945 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-13T02:46:42.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-13T02:46:42.948 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-13T02:46:43.030 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-13T02:46:43.066 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-13T02:46:43.066 INFO:tasks.ceph:Archiving crash dumps... 2024-04-13T02:46:43.068 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/remote/smithi114/crash 2024-04-13T02:46:43.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-13T02:46:43.146 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/remote/smithi130/crash 2024-04-13T02:46:43.147 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-13T02:46:43.173 INFO:tasks.ceph:Shutting down logrotate 2024-04-13T02:46:43.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:43.176 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:43.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:43.410 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-13T02:46:43.437 INFO:tasks.ceph:Compressing logs... 2024-04-13T02:46:43.438 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-13T02:46:43.453 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-13T02:46:43.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45249.log 2024-04-13T02:46:43.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54010.log 2024-04-13T02:46:43.532 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-13T02:46:43.532 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37522.log 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37362.log 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37522.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37482.log 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37362.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37522.log.gz 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37362.log.gz 2024-04-13T02:46:43.533 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37482.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37482.log.gz 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37562.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44294.log 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37602.log 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.3.44294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44294.log.gz 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-13T02:46:43.534 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43893.log 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37602.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44298.log 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37602.log.gz 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.1.43893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37402.log 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr: 93.8% 0.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.1.43893.log.gz 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.3.44298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43898.log 2024-04-13T02:46:43.535 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44298.log.gz 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37402.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.1.43898.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37402.log.gz 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43898.log.gz 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37322.log 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.37322.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.x.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37322.log.gz 2024-04-13T02:46:43.536 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-13T02:46:43.537 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-13T02:46:43.537 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-13T02:46:43.537 INFO:teuthology.orchestra.run.smithi130.stderr: 91.3%/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-13T02:46:43.537 INFO:teuthology.orchestra.run.smithi130.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-13T02:46:43.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-13T02:46:43.564 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.c.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-13T02:46:43.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2024-04-13T02:46:43.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54388.log 2024-04-13T02:46:43.596 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45249.log.gz 2024-04-13T02:46:43.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47999.log 2024-04-13T02:46:43.596 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54010.log.gz 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54388.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54388.log.gz 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52060.log 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47999.log.gz 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49379.log 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51449.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52060.log.gz 2024-04-13T02:46:43.597 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50482.log 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52637.log 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49379.log.gz 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50482.log.gz 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52360.log 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47636.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52637.log.gz 2024-04-13T02:46:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45585.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52360.log.gz 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45933.log 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53220.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45933.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2024-04-13T02:46:43.599 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9%/var/log/ceph/ceph-client.admin.50608.log: -- replaced with /var/log/ceph/ceph-client.admin.45933.log.gz 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51240.log 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50045.log 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51240.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50314.log 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51240.log.gz 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53093.log 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50314.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50045.log.gz 2024-04-13T02:46:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54346.log 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53093.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50314.log.gz 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53033.log 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54346.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.53093.log.gz --verbose 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.53536.log 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53033.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54346.log.gz 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37463.log 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53033.log.gz 2024-04-13T02:46:43.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37463.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43653.log 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.37463.log.gz 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44626.log 2024-04-13T02:46:43.602 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8%/var/log/ceph/ceph-client.admin.43565.log: -- replaced with /var/log/ceph/ceph-client.admin.43653.log.gz 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44630.log 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44626.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50184.log 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50184.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44630.log.gz 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50398.log 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50184.log.gz 2024-04-13T02:46:43.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49169.log 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49169.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50398.log.gz 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49169.log.gz 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45333.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-04-13T02:46:43.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45753.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49877.log 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43609.log 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49877.log: /var/log/ceph/ceph-client.admin.49666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49877.log.gz 2024-04-13T02:46:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43609.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45669.log 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47846.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43609.log.gz 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44288.log 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53758.log 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44288.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45669.log.gz 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49127.log 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53758.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44288.log.gz 2024-04-13T02:46:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53663.log 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53758.log.gz 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48833.log 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54530.log 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49127.log.gz 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48833.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53663.log.gz 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52907.log 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48833.log.gz 2024-04-13T02:46:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51492.log 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54530.log.gz 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49295.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52907.log.gz 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47072.log 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51492.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53262.log 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47072.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51492.log.gz 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2024-04-13T02:46:43.608 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47072.log.gz 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52949.log 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47366.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53262.log.gz 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46946.log 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51932.log 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46946.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52949.log.gz 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52276.log 2024-04-13T02:46:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53578.log 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46946.log.gz 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51932.log.gz 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50566.log 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53578.log.gz 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47468.log 2024-04-13T02:46:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45711.log 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47468.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50566.log.gz 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43695.log 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47468.log.gz 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54136.log 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2024-04-13T02:46:43.611 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45711.log.gz 2024-04-13T02:46:43.612 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54136.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43695.log.gz 2024-04-13T02:46:43.612 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52234.log 2024-04-13T02:46:43.612 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54136.log.gz 2024-04-13T02:46:43.612 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49421.log 2024-04-13T02:46:43.612 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52234.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz 2024-04-13T02:46:43.612 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46287.log 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52234.log.gz 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.46287.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49421.log.gz 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50440.log 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46287.log.gz 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52402.log 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50440.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-13T02:46:43.613 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50440.log.gz 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54178.log 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52402.log.gz 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44964.log 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51658.log 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44964.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54178.log.gz 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44964.log.gz 2024-04-13T02:46:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44958.log 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51658.log: /var/log/ceph/ceph-client.admin.49793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.51658.log.gz 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44958.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54220.log 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.48287.log 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44958.log.gz 2024-04-13T02:46:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49085.log: /var/log/ceph/ceph-client.admin.54220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54262.log 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54220.log.gz 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3%/var/log/ceph/ceph-client.admin.44969.log: -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54052.log 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43294.log 2024-04-13T02:46:43.616 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54262.log.gz 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43397.log 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54052.log.gz 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43294.log.gz 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43397.log.gz 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54094.log 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45627.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2024-04-13T02:46:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51339.log 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54094.log.gz 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53926.log 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49253.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51339.log.gz 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50752.log 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48959.log 2024-04-13T02:46:43.618 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53926.log.gz 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50752.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31414.log 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50752.log.gz 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.tmp-client.admin.31414.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48959.log.gz -5 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31414.log.gz 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50860.log 2024-04-13T02:46:43.619 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45417.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.50860.log.gz -5 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52318.log 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2024-04-13T02:46:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52739.log 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48461.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52318.log.gz 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54488.log 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47324.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52739.log.gz 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52781.log 2024-04-13T02:46:43.621 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50794.log 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54488.log.gz 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52781.log.gz 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52865.log 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54448.log 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50794.log.gz 2024-04-13T02:46:43.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52865.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53136.log 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52865.log.gz 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54448.log: /var/log/ceph/ceph-client.admin.53136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54448.log.gz 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53136.log.gz 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47552.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2024-04-13T02:46:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37800.log 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50089.log 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37800.log.gz 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47426.log 2024-04-13T02:46:43.624 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50089.log.gz 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47426.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45501.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47426.log.gz 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz --verbose 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.43947.log 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47114.log: /var/log/ceph/ceph-client.admin.47804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49961.log 2024-04-13T02:46:43.625 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49961.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43947.log.gz 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45291.log 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49961.log.gz 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46904.log: /var/log/ceph/ceph-client.admin.45291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52595.log 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz 2024-04-13T02:46:43.626 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45291.log.gz 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49543.log 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45207.log 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52595.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49543.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.52595.log.gz --verbose 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.53716.log 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49543.log.gz 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51048.log 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45207.log: /var/log/ceph/ceph-client.admin.53716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-04-13T02:46:43.627 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45207.log.gz 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.51048.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51048.log.gz 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48791.log 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47156.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46729.log 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2024-04-13T02:46:43.628 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48791.log.gz 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.46729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53346.log 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46729.log.gz 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50356.log 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53346.log.gz 2024-04-13T02:46:43.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51130.log 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50356.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51130.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50356.log.gz 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49835.log 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51130.log.gz 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48245.log 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44629.log: /var/log/ceph/ceph-client.admin.49835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49624.log 2024-04-13T02:46:43.630 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49835.log.gz 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53884.log 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49624.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48245.log.gz 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49624.log.gz 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2024-04-13T02:46:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48203.log 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53884.log.gz 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48329.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz --verbose 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.51615.log 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51615.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48203.log.gz 2024-04-13T02:46:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50710.log 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51615.log.gz 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.50710.log: 88.6% --verbose -- /var/log/ceph/ceph-client.admin.53800.log 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43213.log 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50710.log.gz 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-04-13T02:46:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43213.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53800.log.gz 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51860.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43213.log.gz 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49211.log 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.y.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.46282.log 2024-04-13T02:46:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49211.log: /var/log/ceph/ceph-client.0.46282.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.0.46282.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49211.log.gz 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53178.log 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0%/var/log/ceph/ceph-client.admin.50268.log: -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53842.log 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53178.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2024-04-13T02:46:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50524.log 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53178.log.gz 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53842.log: /var/log/ceph/ceph-client.admin.50524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50524.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53842.log.gz 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48629.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47762.log 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-04-13T02:46:43.636 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47198.log 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47762.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51052.log 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47762.log.gz 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49043.log 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.51052.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.0.51052.log.gz 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47198.log.gz 2024-04-13T02:46:43.637 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49043.log.gz 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49337.log 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53968.log: gzip/var/log/ceph/ceph-client.admin.49337.log: -5 --verbose -- 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.44624.log 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48917.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49337.log.gz 2024-04-13T02:46:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-osd.0.log 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52444.log 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44624.log.gz 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43481.log 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43481.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52444.log.gz 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51976.log 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43481.log.gz 2024-04-13T02:46:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44631.log: /var/log/ceph/ceph-client.admin.51976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52018.log 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48545.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51976.log.gz 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 88.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.51283.log 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49463.log 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52018.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53304.log 2024-04-13T02:46:43.640 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51283.log: /var/log/ceph/ceph-client.admin.49463.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53304.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49463.log.gz 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51283.log.gz 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53304.log.gz 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48041.log 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51711.log 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.48041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51711.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48041.log.gz 2024-04-13T02:46:43.641 INFO:teuthology.orchestra.run.smithi114.stderr: 84.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51711.log.gz 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50133.log 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50003.log 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50133.log.gz 2024-04-13T02:46:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37698.log 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50003.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50003.log.gz 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43439.log 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37698.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37698.log.gz 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43439.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43439.log.gz 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44633.log 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47594.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48587.log 2024-04-13T02:46:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44633.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48587.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48587.log.gz 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49751.log 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50226.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49751.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49751.log.gz 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46725.log 2024-04-13T02:46:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46862.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.46725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46725.log.gz 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44292.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45375.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48707.log 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2024-04-13T02:46:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52823.log 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48707.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48707.log.gz 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52823.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52823.log.gz 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54304.log 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52679.log 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6%/var/log/ceph/ceph-client.admin.54304.log: -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2024-04-13T02:46:43.646 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54304.log.gz 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3%/var/log/ceph/ceph-client.admin.45459.log: -- replaced with /var/log/ceph/ceph-client.admin.52679.log.gz 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43863.log 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4%/var/log/ceph/ceph-client.admin.44031.log: -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2024-04-13T02:46:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43863.log: /var/log/ceph/ceph-client.admin.44829.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43863.log.gz 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52119.log 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50668.log: -- /var/log/ceph/ceph-client.admin.44616.log 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44616.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52119.log.gz 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2024-04-13T02:46:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47720.log 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43523.log: /var/log/ceph/ceph-client.admin.47282.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48875.log 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43025.log 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47720.log.gz 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48875.log.gz 2024-04-13T02:46:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52553.log 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43025.log.gz/var/log/ceph/ceph-client.admin.47240.log: 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz/var/log/ceph/ceph-client.admin.52553.log: 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52553.log.gz 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.46988.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48749.log 2024-04-13T02:46:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53620.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-04-13T02:46:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-04-13T02:46:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48749.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48749.log.gz 2024-04-13T02:46:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49919.log 2024-04-13T02:46:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43821.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-04-13T02:46:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49919.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-13T02:46:43.651 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49919.log.gz 2024-04-13T02:46:43.652 INFO:teuthology.orchestra.run.smithi114.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-13T02:46:43.652 INFO:teuthology.orchestra.run.smithi114.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-13T02:46:43.653 INFO:teuthology.orchestra.run.smithi114.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-13T02:46:43.653 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-13T02:46:43.653 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-13T02:46:43.653 INFO:teuthology.orchestra.run.smithi130.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-13T02:46:43.653 INFO:teuthology.orchestra.run.smithi130.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-13T02:46:43.653 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-13T02:46:43.656 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-13T02:46:43.678 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-13T02:46:43.680 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-04-13T02:46:43.680 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m0.184s 2024-04-13T02:46:43.680 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m0.754s 2024-04-13T02:46:43.680 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.051s 2024-04-13T02:46:43.681 INFO:teuthology.orchestra.run.smithi114.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-13T02:46:43.695 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-13T02:46:43.697 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-13T02:46:43.697 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m0.232s 2024-04-13T02:46:43.697 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m0.956s 2024-04-13T02:46:43.698 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.148s 2024-04-13T02:46:43.698 INFO:tasks.ceph:Archiving logs... 2024-04-13T02:46:43.698 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/remote/smithi114/log 2024-04-13T02:46:43.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-13T02:46:44.075 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/remote/smithi130/log 2024-04-13T02:46:44.076 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-13T02:46:44.209 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-13T02:46:44.238 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-13T02:46:44.239 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-13T02:46:44.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-13T02:46:44.316 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-13T02:46:44.327 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-13T02:46:44.328 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T02:46:44.330 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-13T02:46:44.342 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-04-13T02:46:44.344 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-04-13T02:46:44.346 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T02:46:44.346 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-04-13T02:46:44.346 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 41 +1218us[+1217us] +/- 63ms 2024-04-13T02:46:44.346 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -1064us[-1065us] +/- 52ms 2024-04-13T02:46:44.346 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +94us[ +94us] +/- 64ms 2024-04-13T02:46:44.346 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:46:44.348 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-13T02:46:44.348 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-04-13T02:46:44.348 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 40 +1233us[+1233us] +/- 63ms 2024-04-13T02:46:44.348 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -1055us[-1046us] +/- 52ms 2024-04-13T02:46:44.349 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +117us[ +117us] +/- 64ms 2024-04-13T02:46:44.349 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-13T02:46:44.349 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-13T02:46:44.366 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-13T02:46:44.366 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-13T02:46:44.378 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-13T02:46:44.458 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-13T02:46:44.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-13T02:46:44.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:44.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-13T02:46:44.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:44.585 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-13T02:46:44.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-13T02:46:44.605 INFO:teuthology.task.internal:Duration was 563.031312 seconds 2024-04-13T02:46:44.605 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-13T02:46:44.617 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-13T02:46:44.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-13T02:46:44.621 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-13T02:46:44.661 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T02:46:44.668 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-13T02:46:44.923 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-13T02:46:44.924 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-04-13T02:46:44.924 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-13T02:46:44.982 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-04-13T02:46:44.982 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-13T02:46:45.011 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-13T02:46:45.011 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-13T02:46:45.025 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-13T02:46:45.080 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-13T02:46:45.080 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-13T02:46:45.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-13T02:46:45.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-13T02:46:45.231 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-13T02:46:45.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-13T02:46:45.259 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-13T02:46:45.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-13T02:46:45.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-13T02:46:45.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-13T02:46:45.324 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-04-13T02:46:45.351 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-04-13T02:46:45.368 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-13T02:46:45.398 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi114.front.sepia.ceph.com, flagging run as failed 2024-04-13T02:46:45.398 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-13T02:46:45.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:45.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-13T02:46:45.434 INFO:teuthology.task.internal:Transferring archived files... 2024-04-13T02:46:45.435 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/remote/smithi114 2024-04-13T02:46:45.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-13T02:46:54.513 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-13T02:46:54.970 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667/remote/smithi114/coredump/1712976346.49544.core.gz: gzip compressed data, was "1712976346.49544.core", last modified: Sat Apr 13 02:46:45 2024, max compression, original size modulo 2^32 275537920 2024-04-13T02:46:54.971 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-13T02:46:56.139 INFO:teuthology.task.internal: core looks like: /tmp/tmp4wv70iwt: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-13T02:46:56.166 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i a 2024-04-13T02:46:56.167 DEBUG:teuthology.orchestra.run.smithi114:> which 'ceph-mds -f --cluster ceph -i a' 2024-04-13T02:46:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-13T02:46:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-13T02:46:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:/usr/bin/which: no a in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-13T02:46:56.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph-mds 2024-04-13T02:46:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/bin/ceph 2024-04-13T02:46:56.188 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-13T02:46:56.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-13T02:46:56.212 INFO:teuthology.task.internal:Not uploading archives. 2024-04-13T02:46:56.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-13T02:46:56.223 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-13T02:46:56.224 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-13T02:46:56.230 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-13T02:46:56.244 INFO:teuthology.orchestra.run.smithi114.stdout: 265595 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest 2024-04-13T02:46:56.244 INFO:teuthology.orchestra.run.smithi114.stdout: 265596 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest/archive 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 265598 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest/archive/syslog 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 265408 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 13 02:37 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 265422 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 13 02:37 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 265423 188 -rw-r--r-- 1 ubuntu ubuntu 189929 Apr 13 02:46 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 395991 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest/archive/audit 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 396274 144 -rw------- 1 ubuntu ubuntu 146333 Apr 13 02:46 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 265597 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 13 02:45 /home/ubuntu/cephtest/archive/coredump 2024-04-13T02:46:56.245 INFO:teuthology.orchestra.run.smithi114.stdout: 267166 36568 -rw------- 1 root root 275537920 Apr 13 02:45 /home/ubuntu/cephtest/archive/coredump/1712976346.49544.core 2024-04-13T02:46:56.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-13T02:46:56.247 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-13T02:46:56.247 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-13T02:46:56.258 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-13T02:46:56.270 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-13T02:46:56.283 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi114 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-13T02:46:56.283 INFO:teuthology.nuke:Checking targets against current locks 2024-04-13T02:46:56.290 INFO:teuthology.orchestra.run.smithi130.stdout: 265306 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest 2024-04-13T02:46:56.290 INFO:teuthology.orchestra.run.smithi130.stdout: 265307 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest/archive 2024-04-13T02:46:56.291 INFO:teuthology.orchestra.run.smithi130.stdout: 265311 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest/archive/syslog 2024-04-13T02:46:56.291 INFO:teuthology.orchestra.run.smithi130.stdout: 265396 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 13 02:37 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-13T02:46:56.291 INFO:teuthology.orchestra.run.smithi130.stdout: 265313 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 13 02:37 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-13T02:46:56.291 INFO:teuthology.orchestra.run.smithi130.stdout: 265312 184 -rw-r--r-- 1 ubuntu ubuntu 184915 Apr 13 02:46 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-13T02:46:56.291 INFO:teuthology.orchestra.run.smithi130.stdout: 400037 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 13 02:46 /home/ubuntu/cephtest/archive/audit 2024-04-13T02:46:56.291 INFO:teuthology.orchestra.run.smithi130.stdout: 400039 124 -rw------- 1 ubuntu ubuntu 125710 Apr 13 02:46 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-13T02:46:56.292 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-13T02:46:56.315 DEBUG:teuthology.nuke:shortname: smithi114 2024-04-13T02:46:56.316 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-13T02:46:56.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 02:29:02.428895', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDE4YhKRzoHEMOzeuc1OkPtp76JiTyhKvGWF3lV3snxdzoIPxA6aQ2CjyRntFh+gxi2kYhBfZevPWQZg1cBQLzo='} 2024-04-13T02:46:56.342 DEBUG:teuthology.nuke:shortname: smithi130 2024-04-13T02:46:56.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-13T02:46:56.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653667', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 02:29:02.427514', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAevLdcjM1VWjO0GvH+dV2t5V5YP8Z2aQA0cMcZTIXYfY/68XOtEFSsZeRtZf9ulmVQaQT7ZzPy21OyTZ+yMIk='} 2024-04-13T02:46:56.394 INFO:teuthology.orchestra.console.smithi114:Power off 2024-04-13T02:46:56.394 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T02:46:56.419 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2024-04-13T02:46:56.420 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:46:56.438 INFO:teuthology.orchestra.console.smithi130:Power off 2024-04-13T02:46:56.439 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T02:46:56.450 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-04-13T02:46:56.462 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2024-04-13T02:46:56.462 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:46:56.485 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-13T02:47:00.451 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:47:00.486 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:47:00.563 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-04-13T02:47:00.597 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-13T02:47:04.566 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:47:04.598 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:47:04.677 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-04-13T02:47:04.709 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-13T02:47:04.779 INFO:teuthology.orchestra.console.smithi114:Power off completed 2024-04-13T02:47:08.710 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T02:47:08.822 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-13T02:47:08.922 INFO:teuthology.orchestra.console.smithi130:Power off completed 2024-04-13T02:47:09.028 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} duration: 563.0313119888306 failure_reason: 'Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c9282ce33cfe4d2abe15fed063f5aef7 status: fail success: false 2024-04-13T02:47:09.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T02:47:09.122 INFO:teuthology.run:FAIL